[ 520.621104] env[66904]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 520.621104] env[66904]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 521.659660] env[66994]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 521.659660] env[66994]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 523.239913] env[66994]: INFO neutron.common.config [-] Logging enabled! [ 523.240286] env[66994]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 27.0.1.dev60 [ 523.240512] env[66994]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=66994) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 523.240827] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 523.240923] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 523.241849] env[66994]: WARNING oslo_policy.policy [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 523.242109] env[66994]: WARNING oslo_policy.policy [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 523.243745] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] VMware NSXv3 Agent initialized successfully. [ 523.244113] env[66994]: DEBUG oslo_concurrency.lockutils [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] Acquiring lock "singleton_lock" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 523.244244] env[66994]: DEBUG oslo_concurrency.lockutils [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] Acquired lock "singleton_lock" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 523.244449] env[66994]: DEBUG oslo_concurrency.lockutils [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] Releasing lock "singleton_lock" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 523.244739] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] Full set of CONF: {{(pid=66994) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:274}} [ 523.244849] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ******************************************************************************** {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 523.244949] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] Configuration options gathered from: {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 523.245318] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 523.245489] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 523.245596] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ================================================================================ {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 523.245762] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] agent_down_time = 75 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.245898] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] allow_automatic_dhcp_failover = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.246043] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] allow_bulk = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.246191] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] api_extensions_path = {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.246333] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] api_paste_config = api-paste.ini {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.246468] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] auth_strategy = keystone {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.246570] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] backdoor_port = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.246668] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] backdoor_socket = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.246800] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] backlog = 4096 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.246936] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] base_mac = fa:16:3e:00:00:00 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.247103] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] bind_host = 0.0.0.0 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.247246] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] bind_port = 9696 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.247379] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] client_socket_timeout = 900 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.247516] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] config_dir = [] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.247621] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.247754] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] config_source = [] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.247887] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] control_exchange = neutron {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.248034] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] core_plugin = ml2 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.248176] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] debug = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.248311] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] default_availability_zones = [] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.248515] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.248649] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] dhcp_agent_notification = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.248778] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] dhcp_agents_per_network = 1 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.248905] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] dhcp_lease_duration = 86400 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.249055] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] dhcp_load_type = networks {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.249193] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] dns_domain = openstacklocal {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.249328] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.249460] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] enable_default_route_bfd = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.249593] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] enable_default_route_ecmp = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.249724] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] enable_dvr = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.249851] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] enable_new_agents = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.249979] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.250123] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] enable_signals = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.250254] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] enable_traditional_dhcp = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.250381] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] external_dns_driver = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.250509] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] filter_validation = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.250647] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] global_physnet_mtu = 8950 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.250776] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] graceful_shutdown_timeout = 60 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.250948] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] host = cpu-1 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.251151] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] host_dvr_for_dhcp = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.251259] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] http_retries = 3 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.251390] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] instance_format = [instance: %(uuid)s] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.251527] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.251663] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ipam_driver = internal {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.251792] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ipv6_pd_enabled = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.251921] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] l3_ha = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.252069] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.252223] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] l3_ha_network_physical_name = {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.252393] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] l3_ha_network_type = {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.252539] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] log_color = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.252674] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] log_config_append = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.252811] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.252940] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] log_dir = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.253080] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] log_file = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.253182] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] log_options = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.253316] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] log_rotate_interval = 1 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.253456] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] log_rotate_interval_type = days {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.253591] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] log_rotation_type = none {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.253693] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.253825] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.253978] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.254155] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.254259] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.254395] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] max_dns_nameservers = 5 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.254527] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] max_header_line = 16384 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.254656] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] max_l3_agents_per_router = 3 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.254784] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] max_logfile_count = 30 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.254913] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] max_logfile_size_mb = 200 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.255054] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] max_subnet_host_routes = 20 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.255193] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] my_ip = 10.180.1.21 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.255329] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] my_ipv6 = ::1 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.255458] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] network_auto_schedule = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.255585] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] network_link_prefix = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.255721] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.255871] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] notify_nova_on_port_data_changes = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.256046] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] notify_nova_on_port_status_changes = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.256193] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] pagination_max_limit = -1 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.256324] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] publish_errors = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.256454] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] rate_limit_burst = 0 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.256590] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] rate_limit_except_level = CRITICAL {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.256721] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] rate_limit_interval = 0 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.256846] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] retry_until_window = 30 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.256973] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] router_distributed = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.257112] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] rpc_resources_processing_step = 20 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.257244] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] rpc_response_max_timeout = 600 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.257374] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] rpc_response_timeout = 60 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.257499] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] send_events_interval = 2 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.257642] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] service_plugins = ['router'] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.257777] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] setproctitle = on {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.257904] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] shell_completion = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.258048] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] state_path = /opt/stack/data/neutron {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.258184] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] syslog_log_facility = LOG_USER {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.258316] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] tcp_keepidle = 600 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.258449] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] transport_url = **** {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.258576] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] use_journal = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.258701] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] use_json = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.258826] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] use_ssl = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.258949] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] use_stderr = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.259132] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] use_syslog = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.259227] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] vlan_qinq = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.259357] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] vlan_transparent = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.259486] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] watch_log_file = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.259614] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] wsgi_default_pool_size = 100 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.259740] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] wsgi_keep_alive = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.259876] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.260026] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] wsgi_server_debug = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.260166] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_concurrency.disable_process_locking = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.260308] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.260449] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.260580] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.260719] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.260856] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.260987] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.261173] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] profiler.connection_string = messaging:// {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.261323] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] profiler.enabled = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.261465] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] profiler.es_doc_type = notification {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.261602] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] profiler.es_scroll_size = 10000 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.261741] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] profiler.es_scroll_time = 2m {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.261875] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] profiler.filter_error_trace = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.262026] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] profiler.hmac_keys = **** {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.262172] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] profiler.sentinel_service_name = mymaster {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.262339] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] profiler.socket_timeout = 0.1 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.262476] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] profiler.trace_requests = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.262611] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] profiler.trace_sqlalchemy = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.262757] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] profiler_jaeger.process_tags = {} {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.262890] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] profiler_jaeger.service_name_prefix = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.263030] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] profiler_otlp.service_name_prefix = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.263183] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_policy.enforce_new_defaults = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.263457] env[66994]: WARNING oslo_config.cfg [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 523.263607] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_policy.enforce_scope = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.263747] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_policy.policy_default_rule = default {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.263900] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.264059] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.264208] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.264367] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.264507] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.264636] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.264769] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.264907] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_policy.remote_timeout = 60.0 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.265065] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.265214] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] agent.extensions = [] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.265354] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.265494] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] service_providers.service_provider = [] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.265635] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] QUOTAS.default_quota = -1 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.265775] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.265909] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] QUOTAS.quota_floatingip = 50 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.266051] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] QUOTAS.quota_network = 100 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.266186] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] QUOTAS.quota_port = 500 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.266316] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.266442] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] QUOTAS.quota_router = 10 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.266567] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] QUOTAS.quota_security_group = 10 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.266695] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.266824] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] QUOTAS.quota_subnet = 100 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.266955] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] QUOTAS.track_quota_usage = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.267116] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.267251] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep.group = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.267383] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep.helper_command = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.267516] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep.log_daemon_traceback = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.267651] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.267783] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep.thread_pool_size = 8 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.267910] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep.user = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.268062] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.268193] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_dhcp_release.group = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.268321] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_dhcp_release.helper_command = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.268451] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.268584] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.268714] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.268841] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_dhcp_release.user = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.268980] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.269118] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_ovs_vsctl.group = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.269247] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_ovs_vsctl.helper_command = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.269374] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.269508] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.269640] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.269771] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_ovs_vsctl.user = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.269908] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_namespace.capabilities = [21] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.270045] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_namespace.group = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.270179] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_namespace.helper_command = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.270314] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_namespace.log_daemon_traceback = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.270450] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.270581] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_namespace.thread_pool_size = 8 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.270707] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_namespace.user = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.270843] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_conntrack.capabilities = [12] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.270969] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_conntrack.group = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.271138] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_conntrack.helper_command = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.271259] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.271398] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.271528] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.271654] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_conntrack.user = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.271792] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_link.capabilities = [12, 21] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.271921] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_link.group = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.272059] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_link.helper_command = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.272198] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_link.log_daemon_traceback = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.272353] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.272487] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_link.thread_pool_size = 8 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.272614] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] privsep_link.user = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.272762] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.272905] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.273049] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT.continue_on_failed_promotions = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.273181] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT.dscp = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.273314] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT.dscp_inherit = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.273453] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT.force_mp_to_policy = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.273586] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT.locking_coordinator_url = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.273719] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT.log_agent_heartbeats = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.273851] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT.logging_expire = 1 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.273991] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.274138] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.274280] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT.polling_interval = 240 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.274417] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.274556] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.274702] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT.report_interval = 30.0 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.274843] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.274981] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.275132] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.275270] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT.sync_skew = 60 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.275403] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT.synchronization_queue_size = 20 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.275536] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT.use_helper_for_ns_read = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.275675] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] SECURITYGROUP.enable_ipset = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.275845] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] SECURITYGROUP.enable_security_group = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.276025] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.276174] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.276373] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] experimental.ipv6_pd_enabled = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.276555] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ml2.extension_drivers = ['port_security'] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.276696] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ml2.external_network_type = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.276847] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.276991] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ml2.overlay_ip_version = 4 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.277147] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ml2.path_mtu = 8950 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.277291] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ml2.physical_network_mtus = {} {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.277435] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ml2.tenant_network_types = ['vlan'] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.277577] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.277719] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ml2.type_drivers = ['vlan'] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.277865] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT_CLI.neutron_port_id = [] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.278007] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.278151] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.278297] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.278447] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.278583] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.278721] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.278858] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.278996] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.279212] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.279357] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_login_password = **** {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.279501] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_login_port = 443 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.279639] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_login_user = admin {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.279778] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.279916] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.280063] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.280198] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.280337] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.280481] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.280618] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.280757] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.280892] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.281041] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.281224] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.281370] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.281514] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.281727] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.281877] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] vsphere.vsphere_login_password = VMware1! {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.282044] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.282183] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.282353] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] nova.auth_section = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.282505] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] nova.auth_type = password {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.282643] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.282860] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] nova.certfile = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.282927] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] nova.collect_timing = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.283070] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] nova.endpoint_type = public {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.283210] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] nova.insecure = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.283341] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] nova.keyfile = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.283484] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] nova.region_name = RegionOne {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.283619] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] nova.split_loggers = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.283748] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] nova.timeout = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.283884] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] placement.auth_section = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.284035] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] placement.auth_type = password {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.284179] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.284310] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] placement.certfile = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.284442] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] placement.collect_timing = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.284580] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] placement.endpoint_type = public {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.284710] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] placement.insecure = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.284837] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] placement.keyfile = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.284962] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] placement.region_name = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.285104] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] placement.split_loggers = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.285232] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] placement.timeout = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.285369] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.auth_section = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.285503] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.auth_type = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.285630] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.cafile = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.285757] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.certfile = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.285892] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.collect_timing = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.286032] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.connect_retries = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.286167] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.connect_retry_delay = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.286299] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.enable_notifications = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.286424] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.endpoint_override = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.286555] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.insecure = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.286682] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.interface = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.286807] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.keyfile = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.286935] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.max_version = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.287072] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.min_version = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.287202] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.region_name = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.287330] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.retriable_status_codes = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.287456] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.service_name = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.287582] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.service_type = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.287710] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.split_loggers = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.287839] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.status_code_retries = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.287967] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.status_code_retry_delay = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.288107] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.timeout = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.288239] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.valid_interfaces = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.288369] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ironic.version = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.288540] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] cli_script.dry_run = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.288684] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.288815] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.288949] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.289094] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.289226] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.289356] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.289487] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.289618] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.289748] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.289887] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.290021] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.290160] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.290297] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.290433] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.290565] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.290701] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.290828] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.290956] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.291140] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.291314] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.291468] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.291602] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.291732] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.291860] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.291989] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.292136] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.292287] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.292424] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.292553] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.292680] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.292808] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.ssl = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.292948] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.293095] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.293229] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.293367] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.293540] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.ssl_version = {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.293686] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.293830] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_notifications.driver = [] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.293965] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_notifications.retry = -1 {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.294125] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.294257] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] oslo_messaging_notifications.transport_url = **** {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.294357] env[66994]: DEBUG oslo_service.backend._eventlet.service [None req-92a39240-d660-49aa-80d3-36a09b89fa07 None None] ******************************************************************************** {{(pid=66994) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 523.295501] env[66994]: DEBUG neutron.agent.securitygroups_rpc [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Init firewall settings (driver=nsxv3) {{(pid=66994) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 523.296830] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=66994) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 523.297082] env[66994]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] RPC agent_id: nsxm-l-01a.corp.local [ 523.299334] env[66994]: DEBUG dogpile.cache.region [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 523.299450] env[66994]: DEBUG dogpile.lock [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 523.299552] env[66994]: DEBUG dogpile.lock [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 523.299640] env[66994]: DEBUG dogpile.lock [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 523.299729] env[66994]: DEBUG dogpile.cache.region [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 523.299812] env[66994]: DEBUG dogpile.lock [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 523.299935] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 523.322889] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Session token - acquiring [ 523.324834] env[66994]: DEBUG networking_nsxv3.common.locking [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 523.325065] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 523.325135] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 523.325569] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 523.337763] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 523.600727] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 523.622806] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 523.622995] env[66994]: DEBUG dogpile.cache.region [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Cache value generated in 0.323 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 523.623163] env[66994]: DEBUG dogpile.lock [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 523.623321] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Activating Policy API Provider. [ 523.623606] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Looking for the default Infrastructure Rules. [ 523.686748] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Looking for the Default Layer3 Logged Drop Section. [ 523.700780] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 523.701307] env[66994]: DEBUG networking_nsxv3.common.locking [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 523.701466] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquiring lock "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 523.701566] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquired lock "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 523.701846] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquired external semaphore "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 523.702270] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 524.217067] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 524.719666] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 525.222049] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Inventory metadata is going to be refreshed. [ 525.222229] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 525.970302] env[66994]: DEBUG networking_nsxv3.common.locking [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.970725] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.970725] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.970863] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.982428] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 525.984727] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.985389] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 526.002021] env[66994]: DEBUG networking_nsxv3.common.locking [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.002219] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.002343] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.002653] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.002777] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.002921] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 526.003053] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 526.003163] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 526.023309] env[66994]: DEBUG networking_nsxv3.common.locking [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.023530] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.023578] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.023833] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.023995] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.024150] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 526.060583] env[66994]: DEBUG networking_nsxv3.common.locking [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.060841] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.060892] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.061207] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.061336] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.061482] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 526.085388] env[66994]: DEBUG networking_nsxv3.common.locking [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.085614] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquiring lock "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.085614] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquired lock "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.085926] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquired external semaphore "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.086084] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Releasing lock "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.086239] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 526.086343] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 526.086444] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 526.111301] env[66994]: DEBUG networking_nsxv3.common.locking [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.111580] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquiring lock "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.111580] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquired lock "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.111878] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquired external semaphore "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.112019] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Releasing lock "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.112185] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 526.112377] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 526.112554] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 526.137297] env[66994]: DEBUG networking_nsxv3.common.locking [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.137539] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.137539] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.137829] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.137967] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.138128] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 526.138230] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 526.138327] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Inventory metadata have been refreshed. [ 526.138418] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Dryrun:True. Metadata refresh completed. [ 526.138527] env[66994]: DEBUG oslo_concurrency.lockutils [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Releasing lock "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.140210] env[66994]: INFO neutron.agent.agent_extensions_manager [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Loaded agent extensions: [] [ 526.140899] env[66994]: DEBUG neutron_lib.callbacks.manager [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=66994) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 526.201281] env[66994]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] NSXv3 Agent Agent RPC Daemon Started! [ 526.201448] env[66994]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] NSXv3 Agent Agent loop - iteration:0 started [ 526.201491] env[66994]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] NSXv3 Agent Agent out of sync with plugin! [ 531.141370] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 531.141747] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 536.142524] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 536.142524] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 541.111919] env[66994]: INFO networking_nsxv3.common.synchronization [None req-f0e92f37-dfa7-47d1-a2f4-37ebc3b87d59 demo admin] Enqueued Resource ID: e75ebe2c-7d08-4d7c-a177-1e6a0bf505a2 with Priority: HIGHEST for action security_group_rules [ 541.113985] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e75ebe2c-7d08-4d7c-a177-1e6a0bf505a2 with Priority: HIGHEST for action security_group_rules [ 541.114335] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e75ebe2c-7d08-4d7c-a177-1e6a0bf505a2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.114467] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e75ebe2c-7d08-4d7c-a177-1e6a0bf505a2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.114536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e75ebe2c-7d08-4d7c-a177-1e6a0bf505a2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 541.114938] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e75ebe2c-7d08-4d7c-a177-1e6a0bf505a2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 541.115044] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e75ebe2c-7d08-4d7c-a177-1e6a0bf505a2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 541.635646] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.636033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.636033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 541.636149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 541.636180] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 541.636421] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e75ebe2c-7d08-4d7c-a177-1e6a0bf505a2 already deleted. [ 541.636421] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e75ebe2c-7d08-4d7c-a177-1e6a0bf505a2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 542.144436] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.144938] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.144938] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 542.144938] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 542.145329] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 542.647450] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.149954] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.652835] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 543.653066] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 544.395326] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.395818] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.395818] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.395818] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.407844] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 544.408714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.409340] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 544.426780] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.427018] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.427018] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.427209] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.427300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.427403] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 544.427477] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 544.427548] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 544.448246] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.448575] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.448575] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.448702] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.448772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.448886] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 544.468824] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.469068] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.469068] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.469243] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.469362] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.469463] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 544.492510] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.492765] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.492765] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.492916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.493034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.493158] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 544.493232] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 544.493305] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 544.509575] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.509780] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.509780] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.509967] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.510067] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.510178] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 544.510251] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 544.510324] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 544.529601] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.529795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.529795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.529990] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.530102] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.530221] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 544.530296] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 544.530363] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 544.530428] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 544.530505] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 544.530569] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 544.530627] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 544.530895] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 544.530959] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 544.531041] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 544.552022] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.552226] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.552226] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.552435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.552542] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.552653] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 544.571443] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.571656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.571656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.571856] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.571954] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.585415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 546.115078] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 546.115439] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 551.116582] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 551.116582] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 556.118125] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 556.118125] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 561.119875] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 561.122400] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 566.124223] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 566.124223] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 571.125241] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 571.125546] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 572.793249] env[66994]: INFO networking_nsxv3.common.synchronization [None req-c206829a-c607-4810-b171-70a0c9939e91 None None] Enqueued Resource ID: db8f0cbc-7966-4654-8809-258ad152b62a with Priority: HIGHEST for action port [ 572.794082] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db8f0cbc-7966-4654-8809-258ad152b62a with Priority: HIGHEST for action port [ 572.794082] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-db8f0cbc-7966-4654-8809-258ad152b62a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.794082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db8f0cbc-7966-4654-8809-258ad152b62a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.794082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db8f0cbc-7966-4654-8809-258ad152b62a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.794355] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db8f0cbc-7966-4654-8809-258ad152b62a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.794412] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db8f0cbc-7966-4654-8809-258ad152b62a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.007628] env[66994]: INFO networking_nsxv3.common.synchronization [None req-3379009e-4af2-49cb-907b-ae07f2d3a41c None None] Enqueued Resource ID: 2d593db1-2ab0-4657-9906-0e96414b25c1 with Priority: HIGHEST for action port [ 573.007678] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d593db1-2ab0-4657-9906-0e96414b25c1 with Priority: HIGHEST for action port [ 573.007963] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d593db1-2ab0-4657-9906-0e96414b25c1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.008102] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d593db1-2ab0-4657-9906-0e96414b25c1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.008193] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d593db1-2ab0-4657-9906-0e96414b25c1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.008399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d593db1-2ab0-4657-9906-0e96414b25c1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.008634] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d593db1-2ab0-4657-9906-0e96414b25c1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.296418] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db8f0cbc-7966-4654-8809-258ad152b62a [ 573.296509] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.297277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.297277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.297277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.297277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.297277] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db8f0cbc-7966-4654-8809-258ad152b62a already deleted. [ 573.297277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db8f0cbc-7966-4654-8809-258ad152b62a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.513133] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d593db1-2ab0-4657-9906-0e96414b25c1 [ 573.513133] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.513133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.513133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.513133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.513133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.513133] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d593db1-2ab0-4657-9906-0e96414b25c1 already deleted. [ 573.513133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d593db1-2ab0-4657-9906-0e96414b25c1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.715364] env[66994]: INFO networking_nsxv3.common.synchronization [None req-1dac9812-8d22-41f0-9c62-ea5f44efedaf None None] Enqueued Resource ID: ead48dc1-55b5-4513-ba63-40cbb4a7d090 with Priority: HIGHEST for action port [ 573.715364] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ead48dc1-55b5-4513-ba63-40cbb4a7d090 with Priority: HIGHEST for action port [ 573.715364] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-ead48dc1-55b5-4513-ba63-40cbb4a7d090 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.715364] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ead48dc1-55b5-4513-ba63-40cbb4a7d090" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.715757] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ead48dc1-55b5-4513-ba63-40cbb4a7d090" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.718303] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ead48dc1-55b5-4513-ba63-40cbb4a7d090" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.718820] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ead48dc1-55b5-4513-ba63-40cbb4a7d090',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.776550] env[66994]: INFO networking_nsxv3.common.synchronization [None req-34311ae9-04f7-4d8f-9f83-194cb88e4399 None None] Enqueued Resource ID: a75d4bee-4deb-450e-9694-bc918b1474cf with Priority: HIGHEST for action port [ 573.777502] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a75d4bee-4deb-450e-9694-bc918b1474cf with Priority: HIGHEST for action port [ 573.778277] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-a75d4bee-4deb-450e-9694-bc918b1474cf taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.778609] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a75d4bee-4deb-450e-9694-bc918b1474cf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.778911] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a75d4bee-4deb-450e-9694-bc918b1474cf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.779128] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a75d4bee-4deb-450e-9694-bc918b1474cf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.779306] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a75d4bee-4deb-450e-9694-bc918b1474cf',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.220946] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ead48dc1-55b5-4513-ba63-40cbb4a7d090 [ 574.221229] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.222791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.222791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.222791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.222791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.222791] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ead48dc1-55b5-4513-ba63-40cbb4a7d090 already deleted. [ 574.222791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ead48dc1-55b5-4513-ba63-40cbb4a7d090" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.282838] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a75d4bee-4deb-450e-9694-bc918b1474cf [ 574.283211] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.283531] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.283609] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.283809] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.283896] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.283993] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a75d4bee-4deb-450e-9694-bc918b1474cf already deleted. [ 574.284088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a75d4bee-4deb-450e-9694-bc918b1474cf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.885706] env[66994]: INFO networking_nsxv3.common.synchronization [None req-070ae8b9-f69a-4ef9-8ffa-c399857156f0 None None] Enqueued Resource ID: 96bf7b81-8f6b-4f71-8824-683762534b7c with Priority: HIGHEST for action port [ 574.886521] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96bf7b81-8f6b-4f71-8824-683762534b7c with Priority: HIGHEST for action port [ 574.886521] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-96bf7b81-8f6b-4f71-8824-683762534b7c taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.886633] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96bf7b81-8f6b-4f71-8824-683762534b7c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.886678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96bf7b81-8f6b-4f71-8824-683762534b7c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.887602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96bf7b81-8f6b-4f71-8824-683762534b7c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.887602] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96bf7b81-8f6b-4f71-8824-683762534b7c',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.258314] env[66994]: INFO networking_nsxv3.common.synchronization [None req-20807e19-98fd-401c-9cb5-b8f2760a956d None None] Enqueued Resource ID: 6c3c8d9f-1bfd-495b-8f86-0c040cb8a3bb with Priority: HIGHEST for action port [ 575.259604] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c3c8d9f-1bfd-495b-8f86-0c040cb8a3bb with Priority: HIGHEST for action port [ 575.260086] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c3c8d9f-1bfd-495b-8f86-0c040cb8a3bb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.260670] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c3c8d9f-1bfd-495b-8f86-0c040cb8a3bb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.260670] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c3c8d9f-1bfd-495b-8f86-0c040cb8a3bb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.260777] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c3c8d9f-1bfd-495b-8f86-0c040cb8a3bb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.260807] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c3c8d9f-1bfd-495b-8f86-0c040cb8a3bb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.391806] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96bf7b81-8f6b-4f71-8824-683762534b7c [ 575.392070] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.392173] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.392214] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.392428] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.392520] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.392619] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96bf7b81-8f6b-4f71-8824-683762534b7c already deleted. [ 575.392700] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96bf7b81-8f6b-4f71-8824-683762534b7c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.764689] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c3c8d9f-1bfd-495b-8f86-0c040cb8a3bb [ 575.764689] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.764689] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.764689] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.764689] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.764689] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.764689] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c3c8d9f-1bfd-495b-8f86-0c040cb8a3bb already deleted. [ 575.764689] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c3c8d9f-1bfd-495b-8f86-0c040cb8a3bb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.370764] env[66994]: INFO networking_nsxv3.common.synchronization [None req-37333327-77a8-4287-81d6-8a3d00345865 None None] Enqueued Resource ID: bf4776da-3a3f-4830-918f-794528810b9b with Priority: HIGHEST for action port [ 576.371826] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf4776da-3a3f-4830-918f-794528810b9b with Priority: HIGHEST for action port [ 576.372418] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf4776da-3a3f-4830-918f-794528810b9b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.372712] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf4776da-3a3f-4830-918f-794528810b9b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.372861] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf4776da-3a3f-4830-918f-794528810b9b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.373214] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf4776da-3a3f-4830-918f-794528810b9b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.373380] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf4776da-3a3f-4830-918f-794528810b9b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.876108] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf4776da-3a3f-4830-918f-794528810b9b [ 576.877764] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.877764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.877764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.877764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.877764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.877764] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf4776da-3a3f-4830-918f-794528810b9b already deleted. [ 576.877764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf4776da-3a3f-4830-918f-794528810b9b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.209552] env[66994]: INFO networking_nsxv3.common.synchronization [None req-f7c85ef0-faa9-44fe-99e6-b82bafc3b3f1 None None] Enqueued Resource ID: 84f3a920-6f39-4452-b72f-10311889eed0 with Priority: HIGHEST for action port [ 577.210160] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f3a920-6f39-4452-b72f-10311889eed0 with Priority: HIGHEST for action port [ 577.210472] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-84f3a920-6f39-4452-b72f-10311889eed0 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.210600] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84f3a920-6f39-4452-b72f-10311889eed0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.210742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84f3a920-6f39-4452-b72f-10311889eed0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.210907] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84f3a920-6f39-4452-b72f-10311889eed0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.210989] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84f3a920-6f39-4452-b72f-10311889eed0',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.713415] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84f3a920-6f39-4452-b72f-10311889eed0 [ 577.713712] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.713850] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.713850] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.714154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.714208] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.714277] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84f3a920-6f39-4452-b72f-10311889eed0 already deleted. [ 577.714358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84f3a920-6f39-4452-b72f-10311889eed0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.316887] env[66994]: INFO networking_nsxv3.common.synchronization [None req-2d234c5e-b19d-4f04-868a-3055035f3323 None None] Enqueued Resource ID: b38cce94-8699-4a9a-8247-3e7ad663f633 with Priority: HIGHEST for action port [ 578.318041] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b38cce94-8699-4a9a-8247-3e7ad663f633 with Priority: HIGHEST for action port [ 578.318041] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-b38cce94-8699-4a9a-8247-3e7ad663f633 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.318162] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b38cce94-8699-4a9a-8247-3e7ad663f633" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.318162] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b38cce94-8699-4a9a-8247-3e7ad663f633" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.318451] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b38cce94-8699-4a9a-8247-3e7ad663f633" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.318521] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b38cce94-8699-4a9a-8247-3e7ad663f633',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.822483] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b38cce94-8699-4a9a-8247-3e7ad663f633 [ 578.822736] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.822871] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.822942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.823844] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.823844] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.823844] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b38cce94-8699-4a9a-8247-3e7ad663f633 already deleted. [ 578.823844] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b38cce94-8699-4a9a-8247-3e7ad663f633" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.431213] env[66994]: INFO networking_nsxv3.common.synchronization [None req-1f65f6e9-c62f-4e6d-9794-2db20c57b471 None None] Enqueued Resource ID: 62aa513e-dcb2-4fab-bcd2-195aeefe6524 with Priority: HIGHEST for action port [ 579.431213] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62aa513e-dcb2-4fab-bcd2-195aeefe6524 with Priority: HIGHEST for action port [ 579.431525] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-62aa513e-dcb2-4fab-bcd2-195aeefe6524 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.432086] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62aa513e-dcb2-4fab-bcd2-195aeefe6524" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.433875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62aa513e-dcb2-4fab-bcd2-195aeefe6524" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.433875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62aa513e-dcb2-4fab-bcd2-195aeefe6524" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.433875] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62aa513e-dcb2-4fab-bcd2-195aeefe6524',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.937173] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62aa513e-dcb2-4fab-bcd2-195aeefe6524 [ 579.937643] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.937643] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.937793] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.938029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.938159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.938269] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62aa513e-dcb2-4fab-bcd2-195aeefe6524 already deleted. [ 579.938355] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62aa513e-dcb2-4fab-bcd2-195aeefe6524" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.318244] env[66994]: INFO networking_nsxv3.common.synchronization [None req-04fd91dc-9b57-4521-beba-06a848e149ba None None] Enqueued Resource ID: 4fb4b357-0fb5-49cc-a822-0462916fc96e with Priority: HIGHEST for action port [ 580.318351] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fb4b357-0fb5-49cc-a822-0462916fc96e with Priority: HIGHEST for action port [ 580.318618] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fb4b357-0fb5-49cc-a822-0462916fc96e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.318788] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fb4b357-0fb5-49cc-a822-0462916fc96e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.318893] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fb4b357-0fb5-49cc-a822-0462916fc96e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.319562] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fb4b357-0fb5-49cc-a822-0462916fc96e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.319651] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fb4b357-0fb5-49cc-a822-0462916fc96e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.823445] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4fb4b357-0fb5-49cc-a822-0462916fc96e [ 580.823651] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.823800] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.823874] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.824117] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.824212] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.824306] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4fb4b357-0fb5-49cc-a822-0462916fc96e already deleted. [ 580.824415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fb4b357-0fb5-49cc-a822-0462916fc96e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.011903] env[66994]: INFO networking_nsxv3.common.synchronization [None req-53d88336-e051-40ff-af08-7f01fe8ffbe7 None None] Enqueued Resource ID: fc223442-771a-44d2-a933-e6763d672766 with Priority: HIGHEST for action port [ 581.012235] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc223442-771a-44d2-a933-e6763d672766 with Priority: HIGHEST for action port [ 581.012788] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc223442-771a-44d2-a933-e6763d672766 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.012915] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc223442-771a-44d2-a933-e6763d672766" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.012984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc223442-771a-44d2-a933-e6763d672766" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.013252] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc223442-771a-44d2-a933-e6763d672766" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.013341] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc223442-771a-44d2-a933-e6763d672766',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.132215] env[66994]: INFO networking_nsxv3.common.synchronization [None req-e3558e55-e4ff-46b0-ab64-c75e2db3e4f5 None None] Enqueued Resource ID: 136eeaa8-c5b1-4c60-a62d-90c9f3cac729 with Priority: HIGHEST for action port [ 581.133222] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 136eeaa8-c5b1-4c60-a62d-90c9f3cac729 with Priority: HIGHEST for action port [ 581.134313] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-136eeaa8-c5b1-4c60-a62d-90c9f3cac729 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.135024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-136eeaa8-c5b1-4c60-a62d-90c9f3cac729" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.135024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-136eeaa8-c5b1-4c60-a62d-90c9f3cac729" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.135024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-136eeaa8-c5b1-4c60-a62d-90c9f3cac729" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.135182] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('136eeaa8-c5b1-4c60-a62d-90c9f3cac729',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.515807] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc223442-771a-44d2-a933-e6763d672766 [ 581.516083] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.516150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.516182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.516399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.516491] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.516602] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc223442-771a-44d2-a933-e6763d672766 already deleted. [ 581.516687] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc223442-771a-44d2-a933-e6763d672766" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.638825] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 136eeaa8-c5b1-4c60-a62d-90c9f3cac729 [ 581.639090] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.639262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.639335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.639551] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.639640] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.639735] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:136eeaa8-c5b1-4c60-a62d-90c9f3cac729 already deleted. [ 581.639817] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-136eeaa8-c5b1-4c60-a62d-90c9f3cac729" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.916329] env[66994]: INFO networking_nsxv3.common.synchronization [None req-8904ff30-88fa-4981-b0ef-539f31bcc1bd None None] Enqueued Resource ID: ed7bc1a9-113f-4dc5-af16-ffc53d316691 with Priority: HIGHEST for action port [ 582.916992] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed7bc1a9-113f-4dc5-af16-ffc53d316691 with Priority: HIGHEST for action port [ 582.917230] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed7bc1a9-113f-4dc5-af16-ffc53d316691 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.917354] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed7bc1a9-113f-4dc5-af16-ffc53d316691" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.917426] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed7bc1a9-113f-4dc5-af16-ffc53d316691" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.917679] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed7bc1a9-113f-4dc5-af16-ffc53d316691" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.917763] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed7bc1a9-113f-4dc5-af16-ffc53d316691',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.426254] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed7bc1a9-113f-4dc5-af16-ffc53d316691 [ 583.426254] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.426254] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.426254] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.426254] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.426254] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.426254] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed7bc1a9-113f-4dc5-af16-ffc53d316691 already deleted. [ 583.426254] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed7bc1a9-113f-4dc5-af16-ffc53d316691" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.492980] env[66994]: INFO networking_nsxv3.common.synchronization [None req-9a0d2340-d505-49bd-92bb-1cac75ef9f04 tempest-ServersV294TestFqdnHostnames-1429624545 tempest-ServersV294TestFqdnHostnames-1429624545-project-member] Enqueued Resource ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 with Priority: HIGHEST for action security_group_rules [ 583.495282] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 with Priority: HIGHEST for action security_group_rules [ 583.495663] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52c814d2-8c46-4f11-a3ab-47d2b96480f7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.495859] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.496140] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.496445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.497812] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52c814d2-8c46-4f11-a3ab-47d2b96480f7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.709993] env[66994]: INFO networking_nsxv3.common.synchronization [None req-2e345c4e-0887-4b41-ad09-b3acfde6407c tempest-ServersV294TestFqdnHostnames-1429624545 tempest-ServersV294TestFqdnHostnames-1429624545-project-member] Enqueued Resource ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 with Priority: HIGHEST for action security_group_rules [ 583.713637] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 with Priority: HIGHEST for action security_group_rules [ 583.713854] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52c814d2-8c46-4f11-a3ab-47d2b96480f7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.713956] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.763615] env[66994]: INFO networking_nsxv3.common.synchronization [None req-c8605c95-5c97-4dcf-9bc7-6d345c37c434 None None] Enqueued Resource ID: 1ee51256-ac8b-4687-bcb8-97193414a327 with Priority: HIGHEST for action port [ 583.764479] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ee51256-ac8b-4687-bcb8-97193414a327 with Priority: HIGHEST for action port [ 583.764821] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ee51256-ac8b-4687-bcb8-97193414a327 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.764954] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ee51256-ac8b-4687-bcb8-97193414a327" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.765476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ee51256-ac8b-4687-bcb8-97193414a327" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.765935] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ee51256-ac8b-4687-bcb8-97193414a327" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.766040] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ee51256-ac8b-4687-bcb8-97193414a327',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.019136] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.019447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.019447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.019829] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.019829] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.019829] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 already deleted. [ 584.019829] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.020071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.020165] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.020244] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52c814d2-8c46-4f11-a3ab-47d2b96480f7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.268821] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ee51256-ac8b-4687-bcb8-97193414a327 [ 584.269394] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.270331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.270331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.270331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.270331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.270530] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ee51256-ac8b-4687-bcb8-97193414a327 already deleted. [ 584.270843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ee51256-ac8b-4687-bcb8-97193414a327" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.547031] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.547031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.547031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.547264] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.547489] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.547489] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 already deleted. [ 584.547576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.050231] env[66994]: INFO networking_nsxv3.common.synchronization [None req-45a3fae5-b6e1-4baa-8d4e-458f46ce691d None None] Enqueued Resource ID: 14b088f5-a8d2-4507-8db3-13c0ae3c793f with Priority: HIGHEST for action port [ 585.050786] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b088f5-a8d2-4507-8db3-13c0ae3c793f with Priority: HIGHEST for action port [ 585.051102] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-14b088f5-a8d2-4507-8db3-13c0ae3c793f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.051260] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14b088f5-a8d2-4507-8db3-13c0ae3c793f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.051314] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14b088f5-a8d2-4507-8db3-13c0ae3c793f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.051590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14b088f5-a8d2-4507-8db3-13c0ae3c793f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.052535] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14b088f5-a8d2-4507-8db3-13c0ae3c793f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.530363] env[66994]: INFO networking_nsxv3.common.synchronization [req-deba8728-dbc2-4dbd-b0c3-1e1ac0147856 req-d7771e25-89e9-4eb4-b1c9-472088c73cfe tempest-DeleteServersAdminTestJSON-1715216695 tempest-DeleteServersAdminTestJSON-1715216695-project-member] Enqueued Resource ID: 272acbad-bd3f-40f8-972f-dda18f503b74 with Priority: HIGHEST for action security_group_members [ 585.531015] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 272acbad-bd3f-40f8-972f-dda18f503b74 with Priority: HIGHEST for action security_group_members [ 585.531582] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-272acbad-bd3f-40f8-972f-dda18f503b74 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.531582] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.531582] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.531806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.531922] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.532047] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.532090] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.532262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.532380] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.532477] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('272acbad-bd3f-40f8-972f-dda18f503b74',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.554233] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14b088f5-a8d2-4507-8db3-13c0ae3c793f [ 585.554511] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.554644] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.554712] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.555105] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.555105] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.555250] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14b088f5-a8d2-4507-8db3-13c0ae3c793f already deleted. [ 585.555250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14b088f5-a8d2-4507-8db3-13c0ae3c793f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.036288] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.036288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.036288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.036288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.036288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.036288] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.036288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.036288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.036288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.036288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.036288] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 272acbad-bd3f-40f8-972f-dda18f503b74 already deleted. [ 586.036288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.180684] env[66994]: INFO networking_nsxv3.common.synchronization [None req-818a1f2e-e2c6-4678-9d7b-4c33673c3faf None None] Enqueued Resource ID: dc8a5504-d38b-4a66-89e3-c7a88a351d47 with Priority: HIGHEST for action port [ 586.181244] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8a5504-d38b-4a66-89e3-c7a88a351d47 with Priority: HIGHEST for action port [ 586.183974] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc8a5504-d38b-4a66-89e3-c7a88a351d47 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.183974] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc8a5504-d38b-4a66-89e3-c7a88a351d47" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.183974] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc8a5504-d38b-4a66-89e3-c7a88a351d47" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.183974] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc8a5504-d38b-4a66-89e3-c7a88a351d47" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.183974] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc8a5504-d38b-4a66-89e3-c7a88a351d47',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.534631] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.535692] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.535692] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.535692] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.535692] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.535936] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.535936] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.536217] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.536398] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.536757] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 586.536902] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 586.537052] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 586.537194] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 586.537332] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 586.537471] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 586.537635] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 586.562591] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 586.562752] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 586.562884] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 586.563084] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.563437] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-89c91e29-0904-404d-af04-170c8346de80 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.563612] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-89c91e29-0904-404d-af04-170c8346de80" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.563731] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-89c91e29-0904-404d-af04-170c8346de80" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.564054] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-89c91e29-0904-404d-af04-170c8346de80" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.564191] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89c91e29-0904-404d-af04-170c8346de80',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.689210] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc8a5504-d38b-4a66-89e3-c7a88a351d47 [ 586.689447] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.689587] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.689657] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.689896] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.689991] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.690104] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc8a5504-d38b-4a66-89e3-c7a88a351d47 already deleted. [ 586.690166] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc8a5504-d38b-4a66-89e3-c7a88a351d47" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.939276] env[66994]: INFO networking_nsxv3.common.synchronization [None req-dc16536e-a427-49a4-8ef6-298b4bbd8d86 None None] Enqueued Resource ID: a1b4b4db-182f-4393-8048-2aae13e4149f with Priority: HIGHEST for action port [ 586.939975] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b4b4db-182f-4393-8048-2aae13e4149f with Priority: HIGHEST for action port [ 586.940139] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1b4b4db-182f-4393-8048-2aae13e4149f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.940277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1b4b4db-182f-4393-8048-2aae13e4149f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.940332] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1b4b4db-182f-4393-8048-2aae13e4149f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.942548] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1b4b4db-182f-4393-8048-2aae13e4149f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.942548] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1b4b4db-182f-4393-8048-2aae13e4149f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.069101] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.069101] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.069101] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.069101] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.069101] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.069101] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 89c91e29-0904-404d-af04-170c8346de80 not found, creating... [ 587.069101] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.069101] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.069101] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.069101] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.069101] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.069993] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.069993] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.069993] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.069993] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.070340] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.070340] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 89c91e29-0904-404d-af04-170c8346de80 is going to be created. [ 587.098793] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.099021] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.099154] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.099489] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.099711] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.099931] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-89c91e29-0904-404d-af04-170c8346de80" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.251271] env[66994]: INFO networking_nsxv3.common.synchronization [None req-a474c50e-bd2d-451e-ab3d-0f84febb2ff4 None None] Enqueued Resource ID: 0ddfc92d-157e-4cab-8691-01fc7e9516ed with Priority: HIGHEST for action port [ 587.251924] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ddfc92d-157e-4cab-8691-01fc7e9516ed with Priority: HIGHEST for action port [ 587.252304] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ddfc92d-157e-4cab-8691-01fc7e9516ed taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.252480] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ddfc92d-157e-4cab-8691-01fc7e9516ed" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.252552] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ddfc92d-157e-4cab-8691-01fc7e9516ed" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.252843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ddfc92d-157e-4cab-8691-01fc7e9516ed" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.252955] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ddfc92d-157e-4cab-8691-01fc7e9516ed',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.444579] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1b4b4db-182f-4393-8048-2aae13e4149f [ 587.444881] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.444881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.444881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.445136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.445242] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.445293] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1b4b4db-182f-4393-8048-2aae13e4149f already deleted. [ 587.445374] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1b4b4db-182f-4393-8048-2aae13e4149f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.757768] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ddfc92d-157e-4cab-8691-01fc7e9516ed [ 587.757927] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.758029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.758275] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.758370] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.758421] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.758475] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ddfc92d-157e-4cab-8691-01fc7e9516ed already deleted. [ 587.758556] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ddfc92d-157e-4cab-8691-01fc7e9516ed" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.916476] env[66994]: INFO networking_nsxv3.common.synchronization [req-deba8728-dbc2-4dbd-b0c3-1e1ac0147856 req-f39311b7-76db-4abf-bdd7-83f5768db07c service nova] Enqueued Resource ID: 272acbad-bd3f-40f8-972f-dda18f503b74 with Priority: HIGHEST for action security_group_rules [ 587.916610] env[66994]: INFO networking_nsxv3.common.synchronization [req-deba8728-dbc2-4dbd-b0c3-1e1ac0147856 req-f39311b7-76db-4abf-bdd7-83f5768db07c service nova] Enqueued Resource ID: 272acbad-bd3f-40f8-972f-dda18f503b74 with Priority: HIGHEST for action security_group_members [ 587.917212] env[66994]: INFO networking_nsxv3.common.synchronization [req-deba8728-dbc2-4dbd-b0c3-1e1ac0147856 req-f39311b7-76db-4abf-bdd7-83f5768db07c service nova] Enqueued Resource ID: 89c91e29-0904-404d-af04-170c8346de80 with Priority: HIGHEST for action port [ 587.917319] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 272acbad-bd3f-40f8-972f-dda18f503b74 with Priority: HIGHEST for action security_group_rules [ 587.917774] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 272acbad-bd3f-40f8-972f-dda18f503b74 with Priority: HIGHEST for action security_group_members [ 587.917774] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89c91e29-0904-404d-af04-170c8346de80 with Priority: HIGHEST for action port [ 587.917888] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-272acbad-bd3f-40f8-972f-dda18f503b74 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.917970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.918058] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.918968] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.918968] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('272acbad-bd3f-40f8-972f-dda18f503b74',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.919303] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-272acbad-bd3f-40f8-972f-dda18f503b74 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.919453] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.919495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.919684] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.920059] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.920059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.920343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.920525] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.920677] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.920712] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('272acbad-bd3f-40f8-972f-dda18f503b74',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.921759] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-89c91e29-0904-404d-af04-170c8346de80 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.921872] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89c91e29-0904-404d-af04-170c8346de80" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.921942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89c91e29-0904-404d-af04-170c8346de80" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.922136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89c91e29-0904-404d-af04-170c8346de80" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.922242] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89c91e29-0904-404d-af04-170c8346de80',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.176012] env[66994]: INFO networking_nsxv3.common.synchronization [None req-a3ab9abe-bf50-4455-90a5-220cd177de78 None None] Enqueued Resource ID: 433b35ad-a842-4c78-ba4a-4c614edf6e63 with Priority: HIGHEST for action port [ 588.177109] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433b35ad-a842-4c78-ba4a-4c614edf6e63 with Priority: HIGHEST for action port [ 588.177109] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-433b35ad-a842-4c78-ba4a-4c614edf6e63 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.177109] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-433b35ad-a842-4c78-ba4a-4c614edf6e63" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.177437] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-433b35ad-a842-4c78-ba4a-4c614edf6e63" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.177778] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-433b35ad-a842-4c78-ba4a-4c614edf6e63" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.177885] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('433b35ad-a842-4c78-ba4a-4c614edf6e63',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.425044] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-272acbad-bd3f-40f8-972f-dda18f503b74 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.425434] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.436111] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89c91e29-0904-404d-af04-170c8346de80 with status ACTIVE [ 588.437150] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.437965] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.438804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.439161] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.440232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.440306] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.440398] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.440464] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.440740] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.440837] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.441058] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.441162] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.441363] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.441363] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.441443] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.441662] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89c91e29-0904-404d-af04-170c8346de80 is going to be updated. [ 588.443556] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('272acbad-bd3f-40f8-972f-dda18f503b74',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.466930] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.467126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.467181] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.467402] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.468449] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.468449] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89c91e29-0904-404d-af04-170c8346de80" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.600138] env[66994]: INFO networking_nsxv3.common.synchronization [req-bf26b30a-9121-43b7-a519-12a0a6d6733a req-b823b2b0-183b-454d-b3c6-97f98cb8bf38 tempest-ServerExternalEventsTest-1260140305 tempest-ServerExternalEventsTest-1260140305-project-member] Enqueued Resource ID: 34a807f7-3865-4ec7-9af1-5f447e70423b with Priority: HIGHEST for action security_group_members [ 588.601786] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a807f7-3865-4ec7-9af1-5f447e70423b with Priority: HIGHEST for action security_group_members [ 588.601786] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a807f7-3865-4ec7-9af1-5f447e70423b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.601786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.605921] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.606484] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.606484] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.607116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.607116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.607116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.607116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.608621] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a807f7-3865-4ec7-9af1-5f447e70423b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.683523] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 433b35ad-a842-4c78-ba4a-4c614edf6e63 [ 588.683523] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.683523] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.683523] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.683523] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.683523] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.683523] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:433b35ad-a842-4c78-ba4a-4c614edf6e63 already deleted. [ 588.683523] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-433b35ad-a842-4c78-ba4a-4c614edf6e63" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.949157] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('272acbad-bd3f-40f8-972f-dda18f503b74',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.111233] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.111973] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.112078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.112379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.112472] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.112690] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.112794] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.112853] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.112997] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.113080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.113174] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a807f7-3865-4ec7-9af1-5f447e70423b already deleted. [ 589.113462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.145519] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.146091] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.146091] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.147191] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.147557] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.147834] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.147906] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.148225] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.149338] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.149338] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.149338] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 589.149338] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 589.149338] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 589.149338] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.149338] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 589.149338] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 589.174535] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 589.174535] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 589.174535] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 589.174850] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.175336] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-6a19e64c-7a40-4f58-9eb2-065c4eaa4ce5 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.175336] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-6a19e64c-7a40-4f58-9eb2-065c4eaa4ce5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.175552] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-6a19e64c-7a40-4f58-9eb2-065c4eaa4ce5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.175831] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-6a19e64c-7a40-4f58-9eb2-065c4eaa4ce5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.175942] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a19e64c-7a40-4f58-9eb2-065c4eaa4ce5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.450761] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.450761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.450761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.453511] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.453511] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.453511] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 272acbad-bd3f-40f8-972f-dda18f503b74 is going to be created. [ 589.483971] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.484160] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.484209] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.484535] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.484696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.508534] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 272acbad-bd3f-40f8-972f-dda18f503b74 in Status: UNINITIALIZED for 2s [ 589.678811] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.679048] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.679174] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.679460] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.679597] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.679746] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 6a19e64c-7a40-4f58-9eb2-065c4eaa4ce5 not found, creating... [ 589.680072] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.680310] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.680428] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.680638] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.680767] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.681055] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.682029] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.682029] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.682840] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.682990] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.683157] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 6a19e64c-7a40-4f58-9eb2-065c4eaa4ce5 is going to be created. [ 589.713652] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.713652] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.713652] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.713652] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.713652] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.713652] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-6a19e64c-7a40-4f58-9eb2-065c4eaa4ce5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.261977] env[66994]: INFO networking_nsxv3.common.synchronization [None req-245462b1-0d35-412e-b3ce-7fd6ce8c8996 None None] Enqueued Resource ID: 05283026-e601-4b94-979e-4869b0b4a255 with Priority: HIGHEST for action port [ 590.262595] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05283026-e601-4b94-979e-4869b0b4a255 with Priority: HIGHEST for action port [ 590.263075] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-05283026-e601-4b94-979e-4869b0b4a255 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.263339] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05283026-e601-4b94-979e-4869b0b4a255" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.263423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05283026-e601-4b94-979e-4869b0b4a255" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.263709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05283026-e601-4b94-979e-4869b0b4a255" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.263796] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05283026-e601-4b94-979e-4869b0b4a255',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.554098] env[66994]: INFO networking_nsxv3.common.synchronization [req-bf26b30a-9121-43b7-a519-12a0a6d6733a req-6f5927aa-64e6-4660-a5cd-b182aa20a7c5 service nova] Enqueued Resource ID: 34a807f7-3865-4ec7-9af1-5f447e70423b with Priority: HIGHEST for action security_group_rules [ 590.554098] env[66994]: INFO networking_nsxv3.common.synchronization [req-bf26b30a-9121-43b7-a519-12a0a6d6733a req-6f5927aa-64e6-4660-a5cd-b182aa20a7c5 service nova] Enqueued Resource ID: 34a807f7-3865-4ec7-9af1-5f447e70423b with Priority: HIGHEST for action security_group_members [ 590.554098] env[66994]: INFO networking_nsxv3.common.synchronization [req-bf26b30a-9121-43b7-a519-12a0a6d6733a req-6f5927aa-64e6-4660-a5cd-b182aa20a7c5 service nova] Enqueued Resource ID: 6a19e64c-7a40-4f58-9eb2-065c4eaa4ce5 with Priority: HIGHEST for action port [ 590.554642] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a807f7-3865-4ec7-9af1-5f447e70423b with Priority: HIGHEST for action security_group_rules [ 590.554743] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a807f7-3865-4ec7-9af1-5f447e70423b with Priority: HIGHEST for action security_group_members [ 590.554844] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a19e64c-7a40-4f58-9eb2-065c4eaa4ce5 with Priority: HIGHEST for action port [ 590.555193] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34a807f7-3865-4ec7-9af1-5f447e70423b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.555408] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.555447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.557646] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.557646] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34a807f7-3865-4ec7-9af1-5f447e70423b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.559916] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a807f7-3865-4ec7-9af1-5f447e70423b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.559916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.559916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.559916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.559916] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.559916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.559916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.559916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.559916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.559916] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a807f7-3865-4ec7-9af1-5f447e70423b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.560753] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a19e64c-7a40-4f58-9eb2-065c4eaa4ce5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.560871] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a19e64c-7a40-4f58-9eb2-065c4eaa4ce5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.560937] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a19e64c-7a40-4f58-9eb2-065c4eaa4ce5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.561222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a19e64c-7a40-4f58-9eb2-065c4eaa4ce5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.561282] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a19e64c-7a40-4f58-9eb2-065c4eaa4ce5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.766479] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 05283026-e601-4b94-979e-4869b0b4a255 [ 590.766710] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.767101] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.767101] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.767417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.767417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.767417] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:05283026-e601-4b94-979e-4869b0b4a255 already deleted. [ 590.767417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05283026-e601-4b94-979e-4869b0b4a255" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.066328] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a807f7-3865-4ec7-9af1-5f447e70423b taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.066328] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.066328] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34a807f7-3865-4ec7-9af1-5f447e70423b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.066328] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a19e64c-7a40-4f58-9eb2-065c4eaa4ce5 with status ACTIVE [ 591.066328] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.066328] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.066328] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.066328] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.066328] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.066328] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.066328] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.066328] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.066328] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.066328] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.072590] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.072590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.072590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.072590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.072590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.072590] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a19e64c-7a40-4f58-9eb2-065c4eaa4ce5 is going to be updated. [ 591.097352] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.097723] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.097879] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.098176] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.098405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.098679] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a19e64c-7a40-4f58-9eb2-065c4eaa4ce5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.517459] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 272acbad-bd3f-40f8-972f-dda18f503b74 in Status: SUCCESS [ 591.517958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.517958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.518176] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.518371] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.518504] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.518576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.518753] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.518848] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.518942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.519094] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('272acbad-bd3f-40f8-972f-dda18f503b74',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.575616] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34a807f7-3865-4ec7-9af1-5f447e70423b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.699357] env[66994]: INFO networking_nsxv3.common.synchronization [req-59608830-3709-4317-a1bc-9a8ce53203a8 req-82c5e02a-7c46-417b-b4e7-e27479844171 tempest-ServerDiagnosticsNegativeTest-1360381424 tempest-ServerDiagnosticsNegativeTest-1360381424-project-member] Enqueued Resource ID: 841e623a-3249-4bd3-878a-817068626c8a with Priority: HIGHEST for action security_group_members [ 591.699888] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841e623a-3249-4bd3-878a-817068626c8a with Priority: HIGHEST for action security_group_members [ 591.703756] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-841e623a-3249-4bd3-878a-817068626c8a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.703978] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.704068] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.704292] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.704462] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.704590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.704639] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.704762] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.704846] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.704939] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('841e623a-3249-4bd3-878a-817068626c8a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.707524] env[66994]: INFO networking_nsxv3.common.synchronization [None req-68fa9492-3ad6-42b2-94c2-8f415c69797a None None] Enqueued Resource ID: 733c97c7-6f1e-4c9f-8554-3b6fb3f97fb1 with Priority: HIGHEST for action port [ 591.707778] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 733c97c7-6f1e-4c9f-8554-3b6fb3f97fb1 with Priority: HIGHEST for action port [ 591.708183] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-733c97c7-6f1e-4c9f-8554-3b6fb3f97fb1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.708302] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-733c97c7-6f1e-4c9f-8554-3b6fb3f97fb1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.708368] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-733c97c7-6f1e-4c9f-8554-3b6fb3f97fb1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.708585] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-733c97c7-6f1e-4c9f-8554-3b6fb3f97fb1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.708712] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('733c97c7-6f1e-4c9f-8554-3b6fb3f97fb1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.023416] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-272acbad-bd3f-40f8-972f-dda18f503b74 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.023660] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.024987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.024987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.024987] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.024987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.024987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.024987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.025214] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.025293] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.025468] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-272acbad-bd3f-40f8-972f-dda18f503b74 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.025613] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.025700] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.026939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.026939] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.027057] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.027178] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.027298] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.027651] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.027651] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.027651] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('272acbad-bd3f-40f8-972f-dda18f503b74',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.078051] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.078225] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.078267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.078499] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.078696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.078696] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a807f7-3865-4ec7-9af1-5f447e70423b is going to be created. [ 592.111791] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.111791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.111791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.111791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.111791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.126396] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a807f7-3865-4ec7-9af1-5f447e70423b in Status: UNINITIALIZED for 2s [ 592.210040] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.210040] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.210040] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.210040] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.210040] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.210419] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.210419] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.210419] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.211123] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.211123] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.211123] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841e623a-3249-4bd3-878a-817068626c8a already deleted. [ 592.211123] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.211123] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 733c97c7-6f1e-4c9f-8554-3b6fb3f97fb1 [ 592.211362] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.211362] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.211476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.211599] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.211641] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.211810] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:733c97c7-6f1e-4c9f-8554-3b6fb3f97fb1 already deleted. [ 592.211810] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-733c97c7-6f1e-4c9f-8554-3b6fb3f97fb1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.509962] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.510436] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.511699] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.512958] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.513097] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.513801] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.513801] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.513801] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.513999] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.514573] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.514573] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 592.514573] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 592.514726] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 592.514894] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.514972] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 592.515150] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 592.530443] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 272acbad-bd3f-40f8-972f-dda18f503b74: rpc.has_security_group_logging(os_id): False [ 592.547841] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 592.547841] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 592.547841] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 592.547841] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.547841] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-de90d5c7-a573-449e-9e2b-31838ece7739 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.548276] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-de90d5c7-a573-449e-9e2b-31838ece7739" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.548276] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-de90d5c7-a573-449e-9e2b-31838ece7739" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.548699] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-de90d5c7-a573-449e-9e2b-31838ece7739" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.548888] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de90d5c7-a573-449e-9e2b-31838ece7739',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.565949] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.565949] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.566097] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.566785] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.566785] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.567317] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.567472] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.567826] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.569336] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.569336] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.569336] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.569336] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.569336] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.569336] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.569336] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.569336] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.569956] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.570066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.570285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.570397] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.570473] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 272acbad-bd3f-40f8-972f-dda18f503b74 is going to be created. [ 592.586761] env[66994]: INFO networking_nsxv3.common.synchronization [None req-7d1c11a4-f706-4c6f-b463-34b7fbdad2c0 None None] Enqueued Resource ID: 796d5f58-8964-4f33-b2a0-fa24a664c673 with Priority: HIGHEST for action port [ 592.587384] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 796d5f58-8964-4f33-b2a0-fa24a664c673 with Priority: HIGHEST for action port [ 592.587619] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-796d5f58-8964-4f33-b2a0-fa24a664c673 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.587740] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-796d5f58-8964-4f33-b2a0-fa24a664c673" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.587868] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-796d5f58-8964-4f33-b2a0-fa24a664c673" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.588171] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-796d5f58-8964-4f33-b2a0-fa24a664c673" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.588445] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('796d5f58-8964-4f33-b2a0-fa24a664c673',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.657101] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.657101] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.657101] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.657101] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.657101] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.675659] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 272acbad-bd3f-40f8-972f-dda18f503b74 in Status: IN_PROGRESS for 2s [ 592.851731] env[66994]: INFO networking_nsxv3.common.synchronization [None req-1f6d7cf0-8854-4021-a175-3dfa5de4ca4a tempest-VolumesAssistedSnapshotsTest-1112260893 tempest-VolumesAssistedSnapshotsTest-1112260893-project-member] Enqueued Resource ID: dbf01905-0f34-4b82-885d-141b364fdeab with Priority: HIGHEST for action security_group_rules [ 592.852380] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf01905-0f34-4b82-885d-141b364fdeab with Priority: HIGHEST for action security_group_rules [ 592.852719] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbf01905-0f34-4b82-885d-141b364fdeab taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.852918] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.852918] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.853260] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.853356] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbf01905-0f34-4b82-885d-141b364fdeab',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.962243] env[66994]: INFO networking_nsxv3.common.synchronization [None req-bfb81ed7-7c33-4392-a52b-22a46d547dc7 None None] Enqueued Resource ID: c981273d-b361-4db5-9eba-5eb1fecb4d41 with Priority: HIGHEST for action port [ 592.962459] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c981273d-b361-4db5-9eba-5eb1fecb4d41 with Priority: HIGHEST for action port [ 592.962957] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-c981273d-b361-4db5-9eba-5eb1fecb4d41 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.963096] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c981273d-b361-4db5-9eba-5eb1fecb4d41" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.963165] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c981273d-b361-4db5-9eba-5eb1fecb4d41" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.963435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c981273d-b361-4db5-9eba-5eb1fecb4d41" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.966609] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c981273d-b361-4db5-9eba-5eb1fecb4d41',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.052161] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.052161] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.052445] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.052776] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.052776] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.052887] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port de90d5c7-a573-449e-9e2b-31838ece7739 not found, creating... [ 593.053176] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.053367] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.053496] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.053950] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.053950] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.054272] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.054433] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.054566] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.055292] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.055292] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.055292] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: de90d5c7-a573-449e-9e2b-31838ece7739 is going to be created. [ 593.086501] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.086740] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.086868] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.087400] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.087497] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.087654] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-de90d5c7-a573-449e-9e2b-31838ece7739" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.091059] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 796d5f58-8964-4f33-b2a0-fa24a664c673 [ 593.091576] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.091576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.091576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.091943] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.091943] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.091943] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:796d5f58-8964-4f33-b2a0-fa24a664c673 already deleted. [ 593.092197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-796d5f58-8964-4f33-b2a0-fa24a664c673" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.246897] env[66994]: INFO networking_nsxv3.common.synchronization [None req-dbc9aee5-4f46-4781-bb02-85cafe48edd5 tempest-VolumesAssistedSnapshotsTest-1112260893 tempest-VolumesAssistedSnapshotsTest-1112260893-project-member] Enqueued Resource ID: dbf01905-0f34-4b82-885d-141b364fdeab with Priority: HIGHEST for action security_group_rules [ 593.247603] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf01905-0f34-4b82-885d-141b364fdeab with Priority: HIGHEST for action security_group_rules [ 593.248038] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbf01905-0f34-4b82-885d-141b364fdeab taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.248138] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.376747] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.376999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.376999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.377214] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.377303] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.377448] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbf01905-0f34-4b82-885d-141b364fdeab already deleted. [ 593.377534] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.377688] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.377855] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.377931] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbf01905-0f34-4b82-885d-141b364fdeab',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.466164] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c981273d-b361-4db5-9eba-5eb1fecb4d41 [ 593.466536] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.466722] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.466824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.467125] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.467444] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.467444] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c981273d-b361-4db5-9eba-5eb1fecb4d41 already deleted. [ 593.467564] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c981273d-b361-4db5-9eba-5eb1fecb4d41" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.838110] env[66994]: INFO networking_nsxv3.common.synchronization [req-59608830-3709-4317-a1bc-9a8ce53203a8 req-bbf22d20-b484-4e73-9335-538bc4e70281 service nova] Enqueued Resource ID: 841e623a-3249-4bd3-878a-817068626c8a with Priority: HIGHEST for action security_group_rules [ 593.838338] env[66994]: INFO networking_nsxv3.common.synchronization [req-59608830-3709-4317-a1bc-9a8ce53203a8 req-bbf22d20-b484-4e73-9335-538bc4e70281 service nova] Enqueued Resource ID: 841e623a-3249-4bd3-878a-817068626c8a with Priority: HIGHEST for action security_group_members [ 593.838338] env[66994]: INFO networking_nsxv3.common.synchronization [req-59608830-3709-4317-a1bc-9a8ce53203a8 req-bbf22d20-b484-4e73-9335-538bc4e70281 service nova] Enqueued Resource ID: de90d5c7-a573-449e-9e2b-31838ece7739 with Priority: HIGHEST for action port [ 593.838507] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841e623a-3249-4bd3-878a-817068626c8a with Priority: HIGHEST for action security_group_rules [ 593.838666] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841e623a-3249-4bd3-878a-817068626c8a with Priority: HIGHEST for action security_group_members [ 593.838765] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de90d5c7-a573-449e-9e2b-31838ece7739 with Priority: HIGHEST for action port [ 593.841567] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-841e623a-3249-4bd3-878a-817068626c8a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.841567] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.841722] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.841862] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.841944] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('841e623a-3249-4bd3-878a-817068626c8a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.845447] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-841e623a-3249-4bd3-878a-817068626c8a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.845447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.845447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.845447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.845784] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.845784] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.845784] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.846903] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.846903] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.846903] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('841e623a-3249-4bd3-878a-817068626c8a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.846903] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-de90d5c7-a573-449e-9e2b-31838ece7739 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.846903] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de90d5c7-a573-449e-9e2b-31838ece7739" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.847169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de90d5c7-a573-449e-9e2b-31838ece7739" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.847169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de90d5c7-a573-449e-9e2b-31838ece7739" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.847227] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de90d5c7-a573-449e-9e2b-31838ece7739',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.902241] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.902241] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.902241] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.902241] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.902497] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.902497] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbf01905-0f34-4b82-885d-141b364fdeab already deleted. [ 593.902497] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.138563] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a807f7-3865-4ec7-9af1-5f447e70423b in Status: SUCCESS [ 594.138866] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.138984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.139238] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.139434] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.139548] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.139612] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.139761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.139840] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.139921] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.140019] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34a807f7-3865-4ec7-9af1-5f447e70423b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.349767] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('841e623a-3249-4bd3-878a-817068626c8a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.351887] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-841e623a-3249-4bd3-878a-817068626c8a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.351887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.351887] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de90d5c7-a573-449e-9e2b-31838ece7739 with status ACTIVE [ 594.351887] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.351887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.352121] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.352312] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.352417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.353450] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.353450] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.353450] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.353450] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.353450] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.353865] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.353865] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.353865] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.353865] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.354025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.354060] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de90d5c7-a573-449e-9e2b-31838ece7739 is going to be updated. [ 594.378223] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.378407] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.378478] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.378669] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.378805] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.378962] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de90d5c7-a573-449e-9e2b-31838ece7739" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.448581] env[66994]: INFO networking_nsxv3.common.synchronization [None req-ab6618ea-bb1f-41ad-9c2d-6b2f5eb1dcf8 None None] Enqueued Resource ID: b906971e-e12a-4b02-8f51-24dc40547eea with Priority: HIGHEST for action port [ 594.449446] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b906971e-e12a-4b02-8f51-24dc40547eea with Priority: HIGHEST for action port [ 594.449532] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-b906971e-e12a-4b02-8f51-24dc40547eea taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.449939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b906971e-e12a-4b02-8f51-24dc40547eea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.449939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b906971e-e12a-4b02-8f51-24dc40547eea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.450066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b906971e-e12a-4b02-8f51-24dc40547eea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.450499] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b906971e-e12a-4b02-8f51-24dc40547eea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.545356] env[66994]: INFO networking_nsxv3.common.synchronization [req-27b61785-5231-41f2-b392-1d8e02ea0933 req-0296264a-790e-49ca-ac44-c4df42c8d4d5 tempest-TenantUsagesTestJSON-1537662545 tempest-TenantUsagesTestJSON-1537662545-project-member] Enqueued Resource ID: 2f159d71-0083-4a40-882f-2a28e3868c96 with Priority: HIGHEST for action security_group_members [ 594.545990] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f159d71-0083-4a40-882f-2a28e3868c96 with Priority: HIGHEST for action security_group_members [ 594.546897] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f159d71-0083-4a40-882f-2a28e3868c96 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.546897] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.546897] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.546897] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.547184] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.547410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.547511] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.547648] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.547735] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.549293] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f159d71-0083-4a40-882f-2a28e3868c96',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.642357] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a807f7-3865-4ec7-9af1-5f447e70423b taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.642580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.644104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.644423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.644597] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.644736] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.644796] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.644965] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.645072] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.645162] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.645316] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a807f7-3865-4ec7-9af1-5f447e70423b taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.645405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.645467] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.645610] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.645775] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.645827] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.645882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.646022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.646103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.646182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.646269] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34a807f7-3865-4ec7-9af1-5f447e70423b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.688694] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 272acbad-bd3f-40f8-972f-dda18f503b74 in Status: SUCCESS [ 594.690059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.857218] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('841e623a-3249-4bd3-878a-817068626c8a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.954284] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b906971e-e12a-4b02-8f51-24dc40547eea [ 594.954369] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.954490] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.954535] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.954772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.954835] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.954930] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b906971e-e12a-4b02-8f51-24dc40547eea already deleted. [ 594.955037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b906971e-e12a-4b02-8f51-24dc40547eea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.051587] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.051814] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.052324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.052324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.052495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.052871] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.053044] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.053174] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.053604] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.053735] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.053976] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f159d71-0083-4a40-882f-2a28e3868c96 already deleted. [ 595.054140] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.066766] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.066963] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.066999] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.067300] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.067554] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.067707] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.067862] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.069102] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.069102] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.069325] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.069443] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 595.069555] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 595.069661] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 595.069796] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.069954] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 595.070255] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 595.094664] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 595.094968] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 595.095209] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 595.095327] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.095732] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-be58b5ab-c8e5-46e3-9db2-95f5306b754d taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.095932] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-be58b5ab-c8e5-46e3-9db2-95f5306b754d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.096027] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-be58b5ab-c8e5-46e3-9db2-95f5306b754d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.096627] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-be58b5ab-c8e5-46e3-9db2-95f5306b754d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.096865] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be58b5ab-c8e5-46e3-9db2-95f5306b754d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.149045] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34a807f7-3865-4ec7-9af1-5f447e70423b: rpc.has_security_group_logging(os_id): False [ 595.169544] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.169776] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.169776] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.169996] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.170111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.170356] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.170479] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.170479] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.170624] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.170678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.170830] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.171066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.171066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.171192] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.171262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.171447] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.171557] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.171606] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.171922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.171922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.171922] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34a807f7-3865-4ec7-9af1-5f447e70423b is going to be created. [ 595.230305] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.230502] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.230567] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.230737] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.230905] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.242352] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34a807f7-3865-4ec7-9af1-5f447e70423b in Status: IN_PROGRESS for 2s [ 595.361787] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.362229] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.362229] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.362229] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.362760] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.362760] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841e623a-3249-4bd3-878a-817068626c8a is going to be created. [ 595.391475] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.391475] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.391475] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.392896] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.393145] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.418293] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841e623a-3249-4bd3-878a-817068626c8a in Status: UNINITIALIZED for 2s [ 595.599754] env[66994]: INFO networking_nsxv3.common.synchronization [None req-99cbf324-d012-4863-98aa-852174f38101 None None] Enqueued Resource ID: 573805ce-9fb1-4bbb-affd-3f0e571d7394 with Priority: HIGHEST for action port [ 595.600199] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.600376] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.602309] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.602640] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.602799] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.602968] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port be58b5ab-c8e5-46e3-9db2-95f5306b754d not found, creating... [ 595.603285] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.603470] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.603586] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.604846] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.604846] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.604846] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.604846] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.604846] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.604846] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.604846] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.605631] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: be58b5ab-c8e5-46e3-9db2-95f5306b754d is going to be created. [ 595.606390] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 573805ce-9fb1-4bbb-affd-3f0e571d7394 with Priority: HIGHEST for action port [ 595.606715] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-573805ce-9fb1-4bbb-affd-3f0e571d7394 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.606820] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-573805ce-9fb1-4bbb-affd-3f0e571d7394" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.606954] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-573805ce-9fb1-4bbb-affd-3f0e571d7394" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.608381] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-573805ce-9fb1-4bbb-affd-3f0e571d7394" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.608381] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('573805ce-9fb1-4bbb-affd-3f0e571d7394',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.632338] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.632872] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.632872] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.633925] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.634815] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.634815] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-be58b5ab-c8e5-46e3-9db2-95f5306b754d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.111015] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 573805ce-9fb1-4bbb-affd-3f0e571d7394 [ 596.111367] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.111367] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.111459] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.111663] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.111783] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.111858] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:573805ce-9fb1-4bbb-affd-3f0e571d7394 already deleted. [ 596.111919] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-573805ce-9fb1-4bbb-affd-3f0e571d7394" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.292504] env[66994]: INFO networking_nsxv3.common.synchronization [None req-4591137f-7917-4530-a650-2b48e7a68613 None None] Enqueued Resource ID: 84c53ed2-406b-4467-a5c4-426f3495dbcd with Priority: HIGHEST for action port [ 596.293224] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84c53ed2-406b-4467-a5c4-426f3495dbcd with Priority: HIGHEST for action port [ 596.293574] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-84c53ed2-406b-4467-a5c4-426f3495dbcd taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.293702] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84c53ed2-406b-4467-a5c4-426f3495dbcd" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.293764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84c53ed2-406b-4467-a5c4-426f3495dbcd" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.294230] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84c53ed2-406b-4467-a5c4-426f3495dbcd" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.294353] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84c53ed2-406b-4467-a5c4-426f3495dbcd',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.376554] env[66994]: INFO networking_nsxv3.common.synchronization [req-27b61785-5231-41f2-b392-1d8e02ea0933 req-8dade399-7882-4f06-8746-5e3e73159ebb service nova] Enqueued Resource ID: 2f159d71-0083-4a40-882f-2a28e3868c96 with Priority: HIGHEST for action security_group_rules [ 596.376554] env[66994]: INFO networking_nsxv3.common.synchronization [req-27b61785-5231-41f2-b392-1d8e02ea0933 req-8dade399-7882-4f06-8746-5e3e73159ebb service nova] Enqueued Resource ID: 2f159d71-0083-4a40-882f-2a28e3868c96 with Priority: HIGHEST for action security_group_members [ 596.376554] env[66994]: INFO networking_nsxv3.common.synchronization [req-27b61785-5231-41f2-b392-1d8e02ea0933 req-8dade399-7882-4f06-8746-5e3e73159ebb service nova] Enqueued Resource ID: be58b5ab-c8e5-46e3-9db2-95f5306b754d with Priority: HIGHEST for action port [ 596.376554] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f159d71-0083-4a40-882f-2a28e3868c96 with Priority: HIGHEST for action security_group_rules [ 596.377630] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f159d71-0083-4a40-882f-2a28e3868c96 with Priority: HIGHEST for action security_group_members [ 596.377860] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be58b5ab-c8e5-46e3-9db2-95f5306b754d with Priority: HIGHEST for action port [ 596.378422] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f159d71-0083-4a40-882f-2a28e3868c96 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.378666] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.379104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.379571] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.379743] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f159d71-0083-4a40-882f-2a28e3868c96',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.381658] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f159d71-0083-4a40-882f-2a28e3868c96 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.382987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.382987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.382987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.382987] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.382987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.382987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.382987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.382987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.382987] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f159d71-0083-4a40-882f-2a28e3868c96',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.386741] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-be58b5ab-c8e5-46e3-9db2-95f5306b754d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.386741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be58b5ab-c8e5-46e3-9db2-95f5306b754d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.386741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be58b5ab-c8e5-46e3-9db2-95f5306b754d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.386741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be58b5ab-c8e5-46e3-9db2-95f5306b754d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.386741] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be58b5ab-c8e5-46e3-9db2-95f5306b754d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.796988] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84c53ed2-406b-4467-a5c4-426f3495dbcd [ 596.797280] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.798484] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.798484] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.798484] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.798484] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.798484] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84c53ed2-406b-4467-a5c4-426f3495dbcd already deleted. [ 596.798484] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84c53ed2-406b-4467-a5c4-426f3495dbcd" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.889857] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f159d71-0083-4a40-882f-2a28e3868c96 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.890072] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.890304] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f159d71-0083-4a40-882f-2a28e3868c96',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.892226] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be58b5ab-c8e5-46e3-9db2-95f5306b754d with status ACTIVE [ 596.892226] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.892226] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.892226] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.892860] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.893659] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.893659] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.894249] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.894332] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.894506] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.894597] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.894824] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.894932] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.894980] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.897550] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.897656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.897798] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be58b5ab-c8e5-46e3-9db2-95f5306b754d is going to be updated. [ 596.928042] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.928042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.928042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.928042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.928317] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.929133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be58b5ab-c8e5-46e3-9db2-95f5306b754d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.259837] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34a807f7-3865-4ec7-9af1-5f447e70423b in Status: SUCCESS [ 597.259837] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.404024] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f159d71-0083-4a40-882f-2a28e3868c96',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.429632] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841e623a-3249-4bd3-878a-817068626c8a in Status: SUCCESS [ 597.429928] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.430086] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.430421] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.430655] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.431095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.431095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.431095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.431309] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.431309] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.431436] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('841e623a-3249-4bd3-878a-817068626c8a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.908063] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.908063] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.908063] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.908545] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.908545] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.908545] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f159d71-0083-4a40-882f-2a28e3868c96 is going to be created. [ 597.932608] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.933971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.933971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.933971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.934197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.935570] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-841e623a-3249-4bd3-878a-817068626c8a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.935699] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.935770] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.935945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.936113] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.936214] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.936280] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.936447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.936503] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.936587] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.936727] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-841e623a-3249-4bd3-878a-817068626c8a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.936821] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.936885] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.937038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.937179] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.937270] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.937333] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.937507] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.937563] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.937624] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.937713] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('841e623a-3249-4bd3-878a-817068626c8a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.948077] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f159d71-0083-4a40-882f-2a28e3868c96 in Status: UNINITIALIZED for 2s [ 598.305548] env[66994]: INFO networking_nsxv3.common.synchronization [req-08ed84ff-eccb-425d-b074-6b34d18f2b51 req-ae80aebf-990d-4064-866a-2de2acf8b33b tempest-ServersAdminNegativeTestJSON-2113491752 tempest-ServersAdminNegativeTestJSON-2113491752-project-member] Enqueued Resource ID: 91e3865c-9322-423a-9d64-5c548ef52da8 with Priority: HIGHEST for action security_group_members [ 598.307367] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91e3865c-9322-423a-9d64-5c548ef52da8 with Priority: HIGHEST for action security_group_members [ 598.308475] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-91e3865c-9322-423a-9d64-5c548ef52da8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.308475] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.308475] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.323051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.323664] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.323664] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.323664] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.323823] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.323951] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.324836] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91e3865c-9322-423a-9d64-5c548ef52da8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.440558] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 841e623a-3249-4bd3-878a-817068626c8a: rpc.has_security_group_logging(os_id): False [ 598.459397] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.459570] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.459625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.460867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.460867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.460867] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.460867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.460867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.460867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.460867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.460867] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.460867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.460867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.461359] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.461359] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.461359] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.461359] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.461359] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.461633] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.461633] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.461633] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 841e623a-3249-4bd3-878a-817068626c8a is going to be created. [ 598.529516] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.529680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.529726] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.529975] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.530229] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.544358] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 841e623a-3249-4bd3-878a-817068626c8a in Status: IN_PROGRESS for 2s [ 598.724426] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.724664] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.724737] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.725014] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.725280] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.727278] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.727542] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.727805] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.728639] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.728934] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.729077] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 598.729204] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 598.729327] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 598.729624] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.729723] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 598.729888] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 598.750208] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 598.750460] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 598.750663] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 598.751326] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.751789] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-221f0c1e-d849-464e-886c-076d233cb478 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.752012] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-221f0c1e-d849-464e-886c-076d233cb478" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.752142] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-221f0c1e-d849-464e-886c-076d233cb478" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.753086] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-221f0c1e-d849-464e-886c-076d233cb478" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.753086] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('221f0c1e-d849-464e-886c-076d233cb478',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.828524] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.829299] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.829299] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.829299] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.829299] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.829299] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.829576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.829576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.829643] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.829677] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.829746] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91e3865c-9322-423a-9d64-5c548ef52da8 already deleted. [ 598.829821] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.255992] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.256559] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.256559] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.256720] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.256897] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.257083] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 221f0c1e-d849-464e-886c-076d233cb478 not found, creating... [ 599.257339] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.257495] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.257607] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.257834] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.257999] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.258304] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.258468] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.258606] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.258953] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.259148] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.259251] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 221f0c1e-d849-464e-886c-076d233cb478 is going to be created. [ 599.280840] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.281300] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.281476] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.281756] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.282040] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.282300] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-221f0c1e-d849-464e-886c-076d233cb478" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.831114] env[66994]: INFO networking_nsxv3.common.synchronization [None req-03149ac6-9972-4f56-a6ec-c18195feca45 None None] Enqueued Resource ID: a50d73ef-529e-4aa3-b315-a19f68704033 with Priority: HIGHEST for action port [ 599.831628] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a50d73ef-529e-4aa3-b315-a19f68704033 with Priority: HIGHEST for action port [ 599.831830] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-a50d73ef-529e-4aa3-b315-a19f68704033 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.831916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a50d73ef-529e-4aa3-b315-a19f68704033" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.831975] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a50d73ef-529e-4aa3-b315-a19f68704033" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.832268] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a50d73ef-529e-4aa3-b315-a19f68704033" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.832367] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a50d73ef-529e-4aa3-b315-a19f68704033',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.962071] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f159d71-0083-4a40-882f-2a28e3868c96 in Status: SUCCESS [ 599.962071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.962071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.962071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.962547] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.962547] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.962547] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.962742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.962742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.962800] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.962927] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f159d71-0083-4a40-882f-2a28e3868c96',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.060200] env[66994]: INFO networking_nsxv3.common.synchronization [req-08ed84ff-eccb-425d-b074-6b34d18f2b51 req-a1865092-bec8-4f54-9f4b-b8fb29086c2c service nova] Enqueued Resource ID: 91e3865c-9322-423a-9d64-5c548ef52da8 with Priority: HIGHEST for action security_group_rules [ 600.060200] env[66994]: INFO networking_nsxv3.common.synchronization [req-08ed84ff-eccb-425d-b074-6b34d18f2b51 req-a1865092-bec8-4f54-9f4b-b8fb29086c2c service nova] Enqueued Resource ID: 91e3865c-9322-423a-9d64-5c548ef52da8 with Priority: HIGHEST for action security_group_members [ 600.060758] env[66994]: INFO networking_nsxv3.common.synchronization [req-08ed84ff-eccb-425d-b074-6b34d18f2b51 req-a1865092-bec8-4f54-9f4b-b8fb29086c2c service nova] Enqueued Resource ID: 221f0c1e-d849-464e-886c-076d233cb478 with Priority: HIGHEST for action port [ 600.063694] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91e3865c-9322-423a-9d64-5c548ef52da8 with Priority: HIGHEST for action security_group_rules [ 600.063694] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91e3865c-9322-423a-9d64-5c548ef52da8 with Priority: HIGHEST for action security_group_members [ 600.063694] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 221f0c1e-d849-464e-886c-076d233cb478 with Priority: HIGHEST for action port [ 600.063694] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91e3865c-9322-423a-9d64-5c548ef52da8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.063694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.063694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.063694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.063694] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91e3865c-9322-423a-9d64-5c548ef52da8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.063694] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-91e3865c-9322-423a-9d64-5c548ef52da8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.063694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.063694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.063694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.064191] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.064191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.064191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.064379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.064644] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.064897] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91e3865c-9322-423a-9d64-5c548ef52da8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.065704] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-221f0c1e-d849-464e-886c-076d233cb478 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.065819] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-221f0c1e-d849-464e-886c-076d233cb478" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.065904] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-221f0c1e-d849-464e-886c-076d233cb478" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.066179] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-221f0c1e-d849-464e-886c-076d233cb478" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.066179] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('221f0c1e-d849-464e-886c-076d233cb478',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.336969] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a50d73ef-529e-4aa3-b315-a19f68704033 [ 600.336969] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.336969] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.336969] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.336969] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.336969] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.336969] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a50d73ef-529e-4aa3-b315-a19f68704033 already deleted. [ 600.336969] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a50d73ef-529e-4aa3-b315-a19f68704033" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.465786] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f159d71-0083-4a40-882f-2a28e3868c96 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.469576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.469576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.469576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.469576] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.469576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.469576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.469576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.469576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.469576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.469576] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f159d71-0083-4a40-882f-2a28e3868c96 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.469576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.469576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.469576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.469576] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.469576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.469576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.469576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.469576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.470882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.470882] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f159d71-0083-4a40-882f-2a28e3868c96',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.559167] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 841e623a-3249-4bd3-878a-817068626c8a in Status: SUCCESS [ 600.559568] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.568287] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-91e3865c-9322-423a-9d64-5c548ef52da8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.568374] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.568509] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('91e3865c-9322-423a-9d64-5c548ef52da8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.574676] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 221f0c1e-d849-464e-886c-076d233cb478 with status ACTIVE [ 600.574676] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.574676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.574676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.574676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.574676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.574676] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.574676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.574676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.574676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.574676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.574676] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.574676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.574676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.575279] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.575279] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.575279] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 221f0c1e-d849-464e-886c-076d233cb478 is going to be updated. [ 600.600490] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.602224] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.602224] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.602224] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.602224] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.602224] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-221f0c1e-d849-464e-886c-076d233cb478" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.972294] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f159d71-0083-4a40-882f-2a28e3868c96: rpc.has_security_group_logging(os_id): False [ 600.993178] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.993447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.993576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.993924] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.994076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.995155] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.995155] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.995155] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.995155] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.995444] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.995957] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.996101] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.996208] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.996596] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.996753] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.997039] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.997218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.997881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.997881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.997881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.997881] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f159d71-0083-4a40-882f-2a28e3868c96 is going to be created. [ 601.065577] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.066029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.066189] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.066446] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.066673] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.077337] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('91e3865c-9322-423a-9d64-5c548ef52da8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.085902] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f159d71-0083-4a40-882f-2a28e3868c96 in Status: IN_PROGRESS for 2s [ 601.336937] env[66994]: INFO networking_nsxv3.common.synchronization [req-e5c216de-2ac6-42c2-86f3-f24a41f1bc96 req-c438ef73-0d53-4e18-a41b-fc105edd9b0f tempest-ImagesOneServerTestJSON-291128885 tempest-ImagesOneServerTestJSON-291128885-project-member] Enqueued Resource ID: 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a with Priority: HIGHEST for action security_group_members [ 601.337617] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a with Priority: HIGHEST for action security_group_members [ 601.337977] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.338147] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.338232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.338522] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.338698] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.338806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.338880] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.339076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.339164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.339276] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.581942] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.582159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.582272] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.582476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.582604] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.582672] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91e3865c-9322-423a-9d64-5c548ef52da8 is going to be created. [ 601.607045] env[66994]: INFO networking_nsxv3.common.synchronization [None req-7fb4094a-8738-4b16-bc98-ad775419a5e3 None None] Enqueued Resource ID: 7fe70bbd-3af6-4c89-adbc-6ff6a901dc87 with Priority: HIGHEST for action port [ 601.607522] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe70bbd-3af6-4c89-adbc-6ff6a901dc87 with Priority: HIGHEST for action port [ 601.607700] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fe70bbd-3af6-4c89-adbc-6ff6a901dc87 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.607859] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fe70bbd-3af6-4c89-adbc-6ff6a901dc87" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.607940] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fe70bbd-3af6-4c89-adbc-6ff6a901dc87" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.608527] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fe70bbd-3af6-4c89-adbc-6ff6a901dc87" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.608643] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fe70bbd-3af6-4c89-adbc-6ff6a901dc87',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.613331] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.613331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.613331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.613472] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.613840] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.625373] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91e3865c-9322-423a-9d64-5c548ef52da8 in Status: UNINITIALIZED for 2s [ 601.670975] env[66994]: INFO networking_nsxv3.common.synchronization [None req-7edc2072-4231-47b7-bc86-0401dd0af986 None None] Enqueued Resource ID: 36e1e4e3-f7ba-459e-a491-252334db9d2e with Priority: HIGHEST for action port [ 601.671773] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36e1e4e3-f7ba-459e-a491-252334db9d2e with Priority: HIGHEST for action port [ 601.672605] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-36e1e4e3-f7ba-459e-a491-252334db9d2e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.672605] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36e1e4e3-f7ba-459e-a491-252334db9d2e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.672605] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36e1e4e3-f7ba-459e-a491-252334db9d2e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.672605] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36e1e4e3-f7ba-459e-a491-252334db9d2e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.672605] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36e1e4e3-f7ba-459e-a491-252334db9d2e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.841601] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.841830] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.841877] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.842094] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.842193] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.842447] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.842563] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.843226] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.843226] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.843226] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.843226] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a already deleted. [ 601.843226] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.112311] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7fe70bbd-3af6-4c89-adbc-6ff6a901dc87 [ 602.115347] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.115589] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.115666] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.117571] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.117571] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.117571] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7fe70bbd-3af6-4c89-adbc-6ff6a901dc87 already deleted. [ 602.117571] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fe70bbd-3af6-4c89-adbc-6ff6a901dc87" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.176091] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 36e1e4e3-f7ba-459e-a491-252334db9d2e [ 602.176406] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.176843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.176843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.177106] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.177146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.177349] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:36e1e4e3-f7ba-459e-a491-252334db9d2e already deleted. [ 602.177428] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36e1e4e3-f7ba-459e-a491-252334db9d2e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.674866] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.674866] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-547" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.674866] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-547" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.675407] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-547" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.675486] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.675602] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.675719] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.675962] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.676070] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.676270] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.676376] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 602.676594] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 602.676704] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 602.676811] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.676911] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 602.677043] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 602.698360] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 602.698520] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 602.698724] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 602.698957] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-547" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.699352] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-bb84a6c2-6e63-4049-875c-0a25b141c55e taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.699574] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-bb84a6c2-6e63-4049-875c-0a25b141c55e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.700389] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-bb84a6c2-6e63-4049-875c-0a25b141c55e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.700389] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-bb84a6c2-6e63-4049-875c-0a25b141c55e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.700389] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb84a6c2-6e63-4049-875c-0a25b141c55e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.106342] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f159d71-0083-4a40-882f-2a28e3868c96 in Status: SUCCESS [ 603.106342] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.204034] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.204034] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.204034] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.204575] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.204575] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.204575] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port bb84a6c2-6e63-4049-875c-0a25b141c55e not found, creating... [ 603.205153] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.205153] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.205153] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.205470] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.205470] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.205746] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.205862] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.206223] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.206223] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.206347] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.206463] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: bb84a6c2-6e63-4049-875c-0a25b141c55e is going to be created. [ 603.228640] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.228837] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.228958] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.229242] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.229468] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.229733] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-bb84a6c2-6e63-4049-875c-0a25b141c55e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.305146] env[66994]: INFO networking_nsxv3.common.synchronization [req-32a8c6e8-c50b-46d0-bbd5-3e1d88f6e58d req-4114153c-8147-4ac9-9942-c86de1feb91f tempest-ServersAdminTestJSON-1722983547 tempest-ServersAdminTestJSON-1722983547-project-member] Enqueued Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 603.305146] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 603.305309] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.305571] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.305749] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.306467] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.306733] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.307077] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.307996] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.308388] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.308960] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.309180] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.637592] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91e3865c-9322-423a-9d64-5c548ef52da8 in Status: SUCCESS [ 603.637592] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.637592] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.637592] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.638218] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.638363] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.638692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.638692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.638692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.638783] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.638814] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('91e3865c-9322-423a-9d64-5c548ef52da8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.727263] env[66994]: INFO networking_nsxv3.common.synchronization [None req-2fdd7c1d-a5f3-437b-bb52-d261e3ae8ea0 None None] Enqueued Resource ID: 19c721dd-37e6-4ce9-80c6-289763f8c790 with Priority: HIGHEST for action port [ 603.727766] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19c721dd-37e6-4ce9-80c6-289763f8c790 with Priority: HIGHEST for action port [ 603.728686] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-19c721dd-37e6-4ce9-80c6-289763f8c790 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.728833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19c721dd-37e6-4ce9-80c6-289763f8c790" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.728904] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19c721dd-37e6-4ce9-80c6-289763f8c790" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.729179] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19c721dd-37e6-4ce9-80c6-289763f8c790" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.729263] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19c721dd-37e6-4ce9-80c6-289763f8c790',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.739096] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-237 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.739297] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.739417] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.739754] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.740040] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.740163] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.740276] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.740540] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.740711] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.741078] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.741078] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 603.741180] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 603.741223] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 603.741325] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.741428] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 603.741554] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 603.771681] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 603.771850] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 603.771983] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 603.772172] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.772503] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-af46b787-043c-40b9-9932-edaa7b99c6c1 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.772693] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-af46b787-043c-40b9-9932-edaa7b99c6c1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.772812] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-af46b787-043c-40b9-9932-edaa7b99c6c1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.773351] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-af46b787-043c-40b9-9932-edaa7b99c6c1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.773557] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af46b787-043c-40b9-9932-edaa7b99c6c1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.816647] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.816818] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.816907] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.817124] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.817215] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.817403] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.817500] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.817566] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.817884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.817884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.817884] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 already deleted. [ 603.818052] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.954085] env[66994]: INFO networking_nsxv3.common.synchronization [req-e5c216de-2ac6-42c2-86f3-f24a41f1bc96 req-b2602285-afa6-4664-acad-caa37f3a5d16 service nova] Enqueued Resource ID: 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a with Priority: HIGHEST for action security_group_rules [ 603.954132] env[66994]: INFO networking_nsxv3.common.synchronization [req-e5c216de-2ac6-42c2-86f3-f24a41f1bc96 req-b2602285-afa6-4664-acad-caa37f3a5d16 service nova] Enqueued Resource ID: 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a with Priority: HIGHEST for action security_group_members [ 603.954246] env[66994]: INFO networking_nsxv3.common.synchronization [req-e5c216de-2ac6-42c2-86f3-f24a41f1bc96 req-b2602285-afa6-4664-acad-caa37f3a5d16 service nova] Enqueued Resource ID: bb84a6c2-6e63-4049-875c-0a25b141c55e with Priority: HIGHEST for action port [ 603.954789] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a with Priority: HIGHEST for action security_group_rules [ 603.954923] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a with Priority: HIGHEST for action security_group_members [ 603.955176] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb84a6c2-6e63-4049-875c-0a25b141c55e with Priority: HIGHEST for action port [ 603.955703] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.955703] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.955884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.956284] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.956411] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.958211] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.958323] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.958383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.958560] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.958702] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.958798] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.958877] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.959039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.961819] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.961819] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.961819] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb84a6c2-6e63-4049-875c-0a25b141c55e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.961819] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb84a6c2-6e63-4049-875c-0a25b141c55e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.961819] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb84a6c2-6e63-4049-875c-0a25b141c55e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.961819] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb84a6c2-6e63-4049-875c-0a25b141c55e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.961819] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb84a6c2-6e63-4049-875c-0a25b141c55e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.142738] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-91e3865c-9322-423a-9d64-5c548ef52da8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.142915] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.143019] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.143240] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.143451] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.143544] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.143608] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.143758] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.143838] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.143927] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.144095] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-91e3865c-9322-423a-9d64-5c548ef52da8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.144196] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.144245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.144371] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.144502] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.144599] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.144731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.144782] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.144844] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.144971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.146134] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('91e3865c-9322-423a-9d64-5c548ef52da8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.232463] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 19c721dd-37e6-4ce9-80c6-289763f8c790 [ 604.232463] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.232463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.232463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.232463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.232463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.232463] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:19c721dd-37e6-4ce9-80c6-289763f8c790 already deleted. [ 604.232463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19c721dd-37e6-4ce9-80c6-289763f8c790" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.276894] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.277151] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.277276] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.277651] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.277853] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.277853] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port af46b787-043c-40b9-9932-edaa7b99c6c1 not found, creating... [ 604.278123] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.278278] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.278391] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.278603] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.278733] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.278998] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.279159] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.279271] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.279467] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.279589] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.279717] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: af46b787-043c-40b9-9932-edaa7b99c6c1 is going to be created. [ 604.305384] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.305609] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.305699] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.305994] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.306219] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.306477] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-af46b787-043c-40b9-9932-edaa7b99c6c1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.329505] env[66994]: INFO networking_nsxv3.common.synchronization [None req-52eeed8d-06fe-4fe6-999a-66d86f5ad78b None None] Enqueued Resource ID: c9384a3a-2edb-48b1-b9c1-c847febba982 with Priority: HIGHEST for action port [ 604.330126] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9384a3a-2edb-48b1-b9c1-c847febba982 with Priority: HIGHEST for action port [ 604.330497] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9384a3a-2edb-48b1-b9c1-c847febba982 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.330656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9384a3a-2edb-48b1-b9c1-c847febba982" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.330716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9384a3a-2edb-48b1-b9c1-c847febba982" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.331688] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9384a3a-2edb-48b1-b9c1-c847febba982" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.331688] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9384a3a-2edb-48b1-b9c1-c847febba982',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.462746] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.462746] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.462746] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.463854] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb84a6c2-6e63-4049-875c-0a25b141c55e with status ACTIVE [ 604.463854] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.463854] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.463854] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.464102] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.464102] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.464239] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.464288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.464351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.465099] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.465099] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.465099] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.465099] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.465099] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.465540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.465540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.465540] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb84a6c2-6e63-4049-875c-0a25b141c55e is going to be updated. [ 604.490881] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.491038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.491186] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.491420] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.491613] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.492051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb84a6c2-6e63-4049-875c-0a25b141c55e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.647985] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 91e3865c-9322-423a-9d64-5c548ef52da8: rpc.has_security_group_logging(os_id): False [ 604.668646] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.668793] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.669051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.669149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.669149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.669347] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.669442] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.669655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.669655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.669712] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.670059] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.670059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.670293] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.670538] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.670633] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.670881] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.671039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.671166] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.671351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.671471] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.671597] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91e3865c-9322-423a-9d64-5c548ef52da8 is going to be created. [ 604.743385] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.743385] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.743385] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.743385] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.743385] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.755407] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 91e3865c-9322-423a-9d64-5c548ef52da8 in Status: IN_PROGRESS for 2s [ 604.833371] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9384a3a-2edb-48b1-b9c1-c847febba982 [ 604.833371] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.833631] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.833631] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.833868] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.833902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.835368] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9384a3a-2edb-48b1-b9c1-c847febba982 already deleted. [ 604.835368] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9384a3a-2edb-48b1-b9c1-c847febba982" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.968600] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.038721] env[66994]: INFO networking_nsxv3.common.synchronization [req-32a8c6e8-c50b-46d0-bbd5-3e1d88f6e58d req-73bf9604-cf38-420b-8295-87add0d146c0 service nova] Enqueued Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_rules [ 605.039270] env[66994]: INFO networking_nsxv3.common.synchronization [req-32a8c6e8-c50b-46d0-bbd5-3e1d88f6e58d req-73bf9604-cf38-420b-8295-87add0d146c0 service nova] Enqueued Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 605.039481] env[66994]: INFO networking_nsxv3.common.synchronization [req-32a8c6e8-c50b-46d0-bbd5-3e1d88f6e58d req-73bf9604-cf38-420b-8295-87add0d146c0 service nova] Enqueued Resource ID: af46b787-043c-40b9-9932-edaa7b99c6c1 with Priority: HIGHEST for action port [ 605.040066] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_rules [ 605.040248] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 605.040409] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af46b787-043c-40b9-9932-edaa7b99c6c1 with Priority: HIGHEST for action port [ 605.040812] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.040990] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.041157] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.041441] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.041565] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.043051] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.043051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.043051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.043277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.043471] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.043588] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.043655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.043820] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.043917] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.044015] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.047033] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-af46b787-043c-40b9-9932-edaa7b99c6c1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.047233] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af46b787-043c-40b9-9932-edaa7b99c6c1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.048270] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af46b787-043c-40b9-9932-edaa7b99c6c1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.048383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af46b787-043c-40b9-9932-edaa7b99c6c1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.048450] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af46b787-043c-40b9-9932-edaa7b99c6c1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.171460] env[66994]: INFO networking_nsxv3.common.synchronization [req-85755463-53eb-459c-9fab-3d6e9bc757c6 req-e40ef9f8-a6f0-4a34-a1e3-051257664284 tempest-ServersV294TestFqdnHostnames-1429624545 tempest-ServersV294TestFqdnHostnames-1429624545-project-member] Enqueued Resource ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 with Priority: HIGHEST for action security_group_members [ 605.171696] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 with Priority: HIGHEST for action security_group_members [ 605.172198] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-52c814d2-8c46-4f11-a3ab-47d2b96480f7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.173979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.173979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.173979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.173979] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.174194] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.174194] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.174341] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.175230] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.175230] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52c814d2-8c46-4f11-a3ab-47d2b96480f7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.471669] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.471999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.471999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.472355] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.472530] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.472681] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a is going to be created. [ 605.501080] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.501394] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.501471] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.501738] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.501990] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.512347] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a in Status: UNINITIALIZED for 2s [ 605.551564] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.551708] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.551884] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.552978] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af46b787-043c-40b9-9932-edaa7b99c6c1 with status ACTIVE [ 605.553179] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.554105] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.554105] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.554105] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.554105] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.554105] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.554105] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.554105] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.554105] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.554464] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.554464] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.554464] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.554464] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.554607] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.554707] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.554788] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af46b787-043c-40b9-9932-edaa7b99c6c1 is going to be updated. [ 605.569897] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.570194] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-353" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.570390] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-353" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.570776] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-353" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.571042] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.571199] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.571315] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.571528] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.571668] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.571860] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.571967] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 605.572081] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 605.572182] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 605.572284] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.572392] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 605.572537] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 605.582596] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.582750] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.582821] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.583033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.583171] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.583326] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af46b787-043c-40b9-9932-edaa7b99c6c1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.595974] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 605.596194] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 605.596332] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 605.596524] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-353" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.596879] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-17e6eda3-c6da-48e5-92b1-ce596631b245 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.597066] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-17e6eda3-c6da-48e5-92b1-ce596631b245" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.597195] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-17e6eda3-c6da-48e5-92b1-ce596631b245" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.597513] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-17e6eda3-c6da-48e5-92b1-ce596631b245" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.597647] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17e6eda3-c6da-48e5-92b1-ce596631b245',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.680784] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.681116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.681196] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.681701] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.681701] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.681943] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.681943] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.681943] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.682089] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.682321] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.682321] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 already deleted. [ 605.682545] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.057607] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.100059] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.101932] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.101932] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.101932] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.102257] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.102375] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 17e6eda3-c6da-48e5-92b1-ce596631b245 not found, creating... [ 606.102728] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.103612] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.103768] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.104055] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.104424] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.105919] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.105919] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.105919] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.105919] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.105919] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.105919] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 17e6eda3-c6da-48e5-92b1-ce596631b245 is going to be created. [ 606.144953] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.145168] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.145421] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.145779] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.145968] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.146190] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-17e6eda3-c6da-48e5-92b1-ce596631b245" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.562233] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.562233] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.562638] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.562747] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.562862] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.562974] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 is going to be created. [ 606.569272] env[66994]: INFO networking_nsxv3.common.synchronization [req-61be4baf-0753-47ee-896c-4fa0494614fe req-dd9eb239-1ad8-47ae-b0d1-52b5aa4e0322 tempest-DeleteServersAdminTestJSON-1094901049 tempest-DeleteServersAdminTestJSON-1094901049-project-admin] Enqueued Resource ID: 272acbad-bd3f-40f8-972f-dda18f503b74 with Priority: HIGHEST for action security_group_members [ 606.569806] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 272acbad-bd3f-40f8-972f-dda18f503b74 with Priority: HIGHEST for action security_group_members [ 606.570134] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-272acbad-bd3f-40f8-972f-dda18f503b74 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.570260] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.570325] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.571274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.571274] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.571274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.571274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.571274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.571523] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.571523] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('272acbad-bd3f-40f8-972f-dda18f503b74',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.592238] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.592238] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.592238] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.592553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.592553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.604341] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: UNINITIALIZED for 2s [ 606.770164] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 91e3865c-9322-423a-9d64-5c548ef52da8 in Status: SUCCESS [ 606.770164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.821132] env[66994]: INFO networking_nsxv3.common.synchronization [req-85755463-53eb-459c-9fab-3d6e9bc757c6 req-375f43b2-c6b7-446b-b9ef-0fe919fd2e36 service nova] Enqueued Resource ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 with Priority: HIGHEST for action security_group_rules [ 606.821132] env[66994]: INFO networking_nsxv3.common.synchronization [req-85755463-53eb-459c-9fab-3d6e9bc757c6 req-375f43b2-c6b7-446b-b9ef-0fe919fd2e36 service nova] Enqueued Resource ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 with Priority: HIGHEST for action security_group_members [ 606.821274] env[66994]: INFO networking_nsxv3.common.synchronization [req-85755463-53eb-459c-9fab-3d6e9bc757c6 req-375f43b2-c6b7-446b-b9ef-0fe919fd2e36 service nova] Enqueued Resource ID: 17e6eda3-c6da-48e5-92b1-ce596631b245 with Priority: HIGHEST for action port [ 606.821773] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 with Priority: HIGHEST for action security_group_rules [ 606.821898] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 with Priority: HIGHEST for action security_group_members [ 606.822273] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17e6eda3-c6da-48e5-92b1-ce596631b245 with Priority: HIGHEST for action port [ 606.822439] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52c814d2-8c46-4f11-a3ab-47d2b96480f7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.822501] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.822546] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.825282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.825373] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52c814d2-8c46-4f11-a3ab-47d2b96480f7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.826279] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-52c814d2-8c46-4f11-a3ab-47d2b96480f7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.826420] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.826465] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.826640] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.826833] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.826946] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.827024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.827209] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.827256] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.827401] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52c814d2-8c46-4f11-a3ab-47d2b96480f7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.831145] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-17e6eda3-c6da-48e5-92b1-ce596631b245 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.831272] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17e6eda3-c6da-48e5-92b1-ce596631b245" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.831335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17e6eda3-c6da-48e5-92b1-ce596631b245" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.831509] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17e6eda3-c6da-48e5-92b1-ce596631b245" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.831589] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17e6eda3-c6da-48e5-92b1-ce596631b245',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.077031] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.077031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.077031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.077031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.077031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.077031] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.077031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.077031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.077031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.077031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.077031] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 272acbad-bd3f-40f8-972f-dda18f503b74 is going to be updated. [ 607.115203] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.115476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.115710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.115826] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.115978] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.128649] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 272acbad-bd3f-40f8-972f-dda18f503b74 in Status: IN_PROGRESS for 2s [ 607.333551] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-52c814d2-8c46-4f11-a3ab-47d2b96480f7 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.333909] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.334144] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52c814d2-8c46-4f11-a3ab-47d2b96480f7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.338435] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17e6eda3-c6da-48e5-92b1-ce596631b245 with status ACTIVE [ 607.338568] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.339716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.339716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.339716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.339716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.339716] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.339716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.339716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.340084] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.340084] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.340139] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.340630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.340630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.340630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.340630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.340884] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17e6eda3-c6da-48e5-92b1-ce596631b245 is going to be updated. [ 607.371772] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.371928] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.371928] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.372142] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.372266] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.372441] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17e6eda3-c6da-48e5-92b1-ce596631b245" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.533441] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a in Status: SUCCESS [ 607.534298] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.534495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.534788] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.535020] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.535154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.535223] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.535389] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.535472] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.535559] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.535653] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.842861] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52c814d2-8c46-4f11-a3ab-47d2b96480f7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.921156] env[66994]: INFO networking_nsxv3.common.synchronization [req-1574b141-8e03-436d-babd-15addbf42e67 req-d48d427a-e00a-45b6-97a4-eee9eec3425f tempest-FloatingIPsAssociationTestJSON-1494503625 tempest-FloatingIPsAssociationTestJSON-1494503625-project-member] Enqueued Resource ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea with Priority: HIGHEST for action security_group_members [ 607.921802] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea with Priority: HIGHEST for action security_group_members [ 607.923859] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.924204] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.924204] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.924450] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.924654] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.924787] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.924867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.925059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.925286] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.925344] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605734aa-d0fb-486b-9d2a-22c70d9dd0ea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.040933] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.041214] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.041214] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.041578] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.041827] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.041941] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.041999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.042189] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.042286] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.042359] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.042609] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.042694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.042783] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.042901] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.043057] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.043176] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.043285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.043352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.043454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.043542] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.043634] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.345829] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.345999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.346084] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.346295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.346385] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.346572] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 is going to be created. [ 608.388155] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.388155] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.388155] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.388304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.388387] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.401207] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 in Status: UNINITIALIZED for 2s [ 608.429041] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.429041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.429041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.429041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.429041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.429041] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.429041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.429041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.429650] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.429650] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.429650] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea already deleted. [ 608.429650] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.546867] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a: rpc.has_security_group_logging(os_id): False [ 608.569209] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.569209] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.569209] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.569209] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.569209] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.569209] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.569209] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.569499] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.569499] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.569499] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.569693] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.569786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.569845] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.569986] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.570689] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.570689] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.570689] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.570689] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.570689] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.570689] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.570951] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a is going to be created. [ 608.614857] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: SUCCESS [ 608.615373] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.615373] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.615490] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.616335] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.616335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.616335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.616335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.616335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.616335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.616335] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.639535] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.639897] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.640145] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.641231] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.641231] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.657604] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a in Status: IN_PROGRESS for 2s [ 608.817414] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-74 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.818531] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.818531] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.819051] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.820530] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.820530] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.820530] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.820530] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.820530] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.820530] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 608.820530] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 608.820530] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 608.820889] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 608.820889] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 608.820889] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 608.821120] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 608.841323] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 608.841493] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 608.841620] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 608.841794] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.842200] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-f4407d6a-8496-40c8-a187-1597e1e3020f taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.842457] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-f4407d6a-8496-40c8-a187-1597e1e3020f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.842583] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-f4407d6a-8496-40c8-a187-1597e1e3020f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.842925] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-f4407d6a-8496-40c8-a187-1597e1e3020f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.843220] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4407d6a-8496-40c8-a187-1597e1e3020f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.076220] env[66994]: INFO networking_nsxv3.common.synchronization [None req-f823eaad-17f0-4113-a979-809968bcedcb None None] Enqueued Resource ID: fced353d-52e2-4cdc-b6ae-6f0c94493af1 with Priority: HIGHEST for action port [ 609.076220] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fced353d-52e2-4cdc-b6ae-6f0c94493af1 with Priority: HIGHEST for action port [ 609.076220] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-fced353d-52e2-4cdc-b6ae-6f0c94493af1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.076220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fced353d-52e2-4cdc-b6ae-6f0c94493af1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.076220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fced353d-52e2-4cdc-b6ae-6f0c94493af1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.076220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fced353d-52e2-4cdc-b6ae-6f0c94493af1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.076220] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fced353d-52e2-4cdc-b6ae-6f0c94493af1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.127156] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.127156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.127156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.127156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.127156] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.127156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.127156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.127156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.127156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.127156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.127156] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.127156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.127156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.127156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.127156] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.128112] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.128539] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.129104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.129612] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.129805] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.130993] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.149641] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 272acbad-bd3f-40f8-972f-dda18f503b74 in Status: SUCCESS [ 609.149825] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 272acbad-bd3f-40f8-972f-dda18f503b74 deletion is rescheduled due to dependency. [ 609.149952] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.347314] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.347314] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.347314] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.347314] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.347314] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.347314] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port f4407d6a-8496-40c8-a187-1597e1e3020f not found, creating... [ 609.347970] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.347970] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.347970] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.347970] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.347970] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.348251] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.348398] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.348509] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.348706] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.349138] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.349138] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: f4407d6a-8496-40c8-a187-1597e1e3020f is going to be created. [ 609.375371] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.375587] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.375708] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.376603] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.376688] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.376894] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-f4407d6a-8496-40c8-a187-1597e1e3020f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.579148] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fced353d-52e2-4cdc-b6ae-6f0c94493af1 [ 609.579390] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.579531] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.579600] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.579850] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.579946] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.580053] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fced353d-52e2-4cdc-b6ae-6f0c94493af1 already deleted. [ 609.580132] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fced353d-52e2-4cdc-b6ae-6f0c94493af1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.633860] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5dbec57c-866e-4292-acf4-6de3635c21b3: rpc.has_security_group_logging(os_id): False [ 609.652940] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.653106] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.653182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.653390] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.653647] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.653933] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.654094] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.654169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.654297] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.654379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.654579] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.654685] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.656103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.656103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.656103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.656103] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.656103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.656103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.656103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.656103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.656103] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 is going to be created. [ 609.724182] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.724182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.724182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.724182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.724182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.736282] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: IN_PROGRESS for 2s [ 610.107671] env[66994]: INFO networking_nsxv3.common.synchronization [req-1574b141-8e03-436d-babd-15addbf42e67 req-e97b449a-6a9c-4900-81ec-a3cc5a29a47f service nova] Enqueued Resource ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea with Priority: HIGHEST for action security_group_rules [ 610.108862] env[66994]: INFO networking_nsxv3.common.synchronization [req-1574b141-8e03-436d-babd-15addbf42e67 req-e97b449a-6a9c-4900-81ec-a3cc5a29a47f service nova] Enqueued Resource ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea with Priority: HIGHEST for action security_group_members [ 610.108862] env[66994]: INFO networking_nsxv3.common.synchronization [req-1574b141-8e03-436d-babd-15addbf42e67 req-e97b449a-6a9c-4900-81ec-a3cc5a29a47f service nova] Enqueued Resource ID: f4407d6a-8496-40c8-a187-1597e1e3020f with Priority: HIGHEST for action port [ 610.110143] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea with Priority: HIGHEST for action security_group_rules [ 610.110499] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea with Priority: HIGHEST for action security_group_members [ 610.110825] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4407d6a-8496-40c8-a187-1597e1e3020f with Priority: HIGHEST for action port [ 610.111345] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605734aa-d0fb-486b-9d2a-22c70d9dd0ea taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.114020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.114020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.114020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.114020] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605734aa-d0fb-486b-9d2a-22c70d9dd0ea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.114020] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.114020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.114020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.114020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.114020] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.114020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.114020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.114020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.114020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.115194] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605734aa-d0fb-486b-9d2a-22c70d9dd0ea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.117622] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4407d6a-8496-40c8-a187-1597e1e3020f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.117902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4407d6a-8496-40c8-a187-1597e1e3020f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.118084] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4407d6a-8496-40c8-a187-1597e1e3020f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.118348] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4407d6a-8496-40c8-a187-1597e1e3020f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.118529] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4407d6a-8496-40c8-a187-1597e1e3020f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.414364] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 in Status: SUCCESS [ 610.414570] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.415559] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.415559] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.415559] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.415559] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.415559] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.415559] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.416207] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.416207] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.416207] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52c814d2-8c46-4f11-a3ab-47d2b96480f7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.620489] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605734aa-d0fb-486b-9d2a-22c70d9dd0ea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.621396] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4407d6a-8496-40c8-a187-1597e1e3020f with status ACTIVE [ 610.621608] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.621737] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.621803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.622031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.622113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.622292] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.622395] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.622494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.622658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.622736] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.622917] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.623021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.623086] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.623232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.623306] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.623389] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4407d6a-8496-40c8-a187-1597e1e3020f is going to be updated. [ 610.627764] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.628107] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.652041] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.652235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.652280] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.652521] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.652631] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.652786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4407d6a-8496-40c8-a187-1597e1e3020f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.671801] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a in Status: SUCCESS [ 610.672053] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.919744] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52c814d2-8c46-4f11-a3ab-47d2b96480f7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.018949] env[66994]: INFO networking_nsxv3.common.synchronization [req-fc1078c0-70fe-41ac-b0a2-922d17e8f099 req-ac574d86-5075-4e29-96c6-56303cc90dba tempest-ServersAdminTestJSON-1722983547 tempest-ServersAdminTestJSON-1722983547-project-member] Enqueued Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 611.019521] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 611.019848] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.019974] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.023169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.023169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.023169] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.023169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.023169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.023169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.023169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.023169] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.130288] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605734aa-d0fb-486b-9d2a-22c70d9dd0ea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.422326] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52c814d2-8c46-4f11-a3ab-47d2b96480f7: rpc.has_security_group_logging(os_id): False [ 611.441462] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.441616] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.441733] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.441980] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.442215] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.442330] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.442436] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.442568] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.442725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.442795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.442889] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 is going to be created. [ 611.492412] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-237 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.492691] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.492887] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.494172] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.494268] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.495439] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.495752] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.495805] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.495981] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.496842] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.496842] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 611.496842] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 611.496842] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 611.496842] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.496842] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 611.496842] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 611.511686] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.511856] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.511856] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.512054] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.512247] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.517308] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 611.517454] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 611.517678] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 611.517937] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.519068] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-ebafeb93-602e-4837-a257-51583b5a4779 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.520150] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-ebafeb93-602e-4837-a257-51583b5a4779" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.520150] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-ebafeb93-602e-4837-a257-51583b5a4779" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.520150] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-ebafeb93-602e-4837-a257-51583b5a4779" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.520150] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebafeb93-602e-4837-a257-51583b5a4779',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.523286] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 in Status: IN_PROGRESS for 2s [ 611.526641] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.636935] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.636935] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.637182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.637944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.637944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.637944] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea is going to be created. [ 611.664549] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.664693] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.664775] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.665050] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.665161] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.676113] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea in Status: UNINITIALIZED for 2s [ 611.750941] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: SUCCESS [ 611.751191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.835680] env[66994]: INFO networking_nsxv3.common.synchronization [None req-cab3a2f3-966e-4b23-ab40-54544024dede None None] Enqueued Resource ID: 38c2ffdb-e75b-409b-9a94-0e29629094d1 with Priority: HIGHEST for action port [ 611.835680] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38c2ffdb-e75b-409b-9a94-0e29629094d1 with Priority: HIGHEST for action port [ 611.835680] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-38c2ffdb-e75b-409b-9a94-0e29629094d1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.835680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38c2ffdb-e75b-409b-9a94-0e29629094d1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.835680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38c2ffdb-e75b-409b-9a94-0e29629094d1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.836279] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38c2ffdb-e75b-409b-9a94-0e29629094d1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.836588] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38c2ffdb-e75b-409b-9a94-0e29629094d1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.021971] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.022329] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.022519] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.022851] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.023057] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.023299] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port ebafeb93-602e-4837-a257-51583b5a4779 not found, creating... [ 612.023704] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.023943] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.024147] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.024668] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.024980] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.025329] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.025556] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.025727] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.026056] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.026289] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.026507] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: ebafeb93-602e-4837-a257-51583b5a4779 is going to be created. [ 612.028417] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.056413] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.056630] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.056938] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.057061] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.057292] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.057514] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-ebafeb93-602e-4837-a257-51583b5a4779" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.116489] env[66994]: INFO networking_nsxv3.common.synchronization [None req-1fcb6c70-b7fd-4fc1-8a7a-7d05588ab94a tempest-ServersTestBootFromVolume-2076386020 tempest-ServersTestBootFromVolume-2076386020-project-member] Enqueued Resource ID: 7176e416-370c-4ff8-be5b-5551a672ed01 with Priority: HIGHEST for action security_group_rules [ 612.116489] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7176e416-370c-4ff8-be5b-5551a672ed01 with Priority: HIGHEST for action security_group_rules [ 612.117321] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7176e416-370c-4ff8-be5b-5551a672ed01 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.118760] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.118760] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.118760] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.118760] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7176e416-370c-4ff8-be5b-5551a672ed01',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.340856] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38c2ffdb-e75b-409b-9a94-0e29629094d1 [ 612.341347] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.341347] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.341549] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.341611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.341836] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.341946] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38c2ffdb-e75b-409b-9a94-0e29629094d1 already deleted. [ 612.342045] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38c2ffdb-e75b-409b-9a94-0e29629094d1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.531689] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.531920] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.532038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.532282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.532396] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.532591] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 is going to be updated. [ 612.570256] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.571423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.571423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.571423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.571423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.594062] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: IN_PROGRESS for 2s [ 612.655602] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.655966] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.655966] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.656068] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.656575] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.656575] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7176e416-370c-4ff8-be5b-5551a672ed01 already deleted. [ 612.656575] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.687774] env[66994]: INFO networking_nsxv3.common.synchronization [None req-50b9c651-ffd3-4347-b617-e9cc55bec517 tempest-ServersTestBootFromVolume-2076386020 tempest-ServersTestBootFromVolume-2076386020-project-member] Enqueued Resource ID: 7176e416-370c-4ff8-be5b-5551a672ed01 with Priority: HIGHEST for action security_group_rules [ 612.688389] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7176e416-370c-4ff8-be5b-5551a672ed01 with Priority: HIGHEST for action security_group_rules [ 612.688838] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7176e416-370c-4ff8-be5b-5551a672ed01 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.689077] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.689077] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.689333] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.689333] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7176e416-370c-4ff8-be5b-5551a672ed01',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.847307] env[66994]: INFO networking_nsxv3.common.synchronization [req-fc1078c0-70fe-41ac-b0a2-922d17e8f099 req-cb328017-4f0d-4391-9792-f7337732a791 service nova] Enqueued Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_rules [ 612.847807] env[66994]: INFO networking_nsxv3.common.synchronization [req-fc1078c0-70fe-41ac-b0a2-922d17e8f099 req-cb328017-4f0d-4391-9792-f7337732a791 service nova] Enqueued Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 612.847807] env[66994]: INFO networking_nsxv3.common.synchronization [req-fc1078c0-70fe-41ac-b0a2-922d17e8f099 req-cb328017-4f0d-4391-9792-f7337732a791 service nova] Enqueued Resource ID: ebafeb93-602e-4837-a257-51583b5a4779 with Priority: HIGHEST for action port [ 612.848664] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_rules [ 612.848832] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 612.848979] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebafeb93-602e-4837-a257-51583b5a4779 with Priority: HIGHEST for action port [ 612.849284] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.850038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.850038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.850038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.850038] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.851591] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.851703] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.852029] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebafeb93-602e-4837-a257-51583b5a4779 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.852211] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebafeb93-602e-4837-a257-51583b5a4779" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.852442] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebafeb93-602e-4837-a257-51583b5a4779" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.852764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebafeb93-602e-4837-a257-51583b5a4779" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.852764] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebafeb93-602e-4837-a257-51583b5a4779',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.213209] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.213340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.213464] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.213745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.213843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.213957] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7176e416-370c-4ff8-be5b-5551a672ed01 already deleted. [ 613.214052] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.351943] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.352427] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.356731] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ebafeb93-602e-4837-a257-51583b5a4779 with status ACTIVE [ 613.356998] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.357180] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.357285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.357579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.357671] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.357861] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.357984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.358056] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.358243] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.358369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.358672] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.358818] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.358918] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.359143] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.359236] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.359317] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ebafeb93-602e-4837-a257-51583b5a4779 is going to be updated. [ 613.389665] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.390156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.390472] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.391022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.391227] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.391480] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebafeb93-602e-4837-a257-51583b5a4779" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.544259] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 in Status: SUCCESS [ 613.545602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.688547] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea in Status: SUCCESS [ 613.688945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.689257] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.689627] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.689960] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.690214] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.690361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.690678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.690806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.691104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.691431] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('605734aa-d0fb-486b-9d2a-22c70d9dd0ea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.800902] env[66994]: INFO networking_nsxv3.common.synchronization [req-f9aea3e7-237d-4a43-85b6-7a200fb6cb61 req-19e6d447-1445-4b05-bcd5-b5f4d3eae857 tempest-ImagesNegativeTestJSON-763648599 tempest-ImagesNegativeTestJSON-763648599-project-member] Enqueued Resource ID: c80fb398-76b1-47f9-8bb6-a122061a01d6 with Priority: HIGHEST for action security_group_members [ 613.801609] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c80fb398-76b1-47f9-8bb6-a122061a01d6 with Priority: HIGHEST for action security_group_members [ 613.801734] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-c80fb398-76b1-47f9-8bb6-a122061a01d6 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.801859] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.801927] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.802904] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.803152] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.803274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.803357] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.803849] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.803849] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.804370] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c80fb398-76b1-47f9-8bb6-a122061a01d6',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.922081] env[66994]: INFO networking_nsxv3.common.synchronization [req-b2989791-86cc-4e2f-9dc2-16624dce6b77 req-bc662ca9-e6dd-40bd-92dc-c6d7ee8ca62c tempest-ServerExternalEventsTest-1260140305 tempest-ServerExternalEventsTest-1260140305-project-member] Enqueued Resource ID: 34a807f7-3865-4ec7-9af1-5f447e70423b with Priority: HIGHEST for action security_group_members [ 613.922081] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a807f7-3865-4ec7-9af1-5f447e70423b with Priority: HIGHEST for action security_group_members [ 613.922225] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a807f7-3865-4ec7-9af1-5f447e70423b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.922289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.922354] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.922586] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.922751] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.922862] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.922925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.923284] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.924171] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.924171] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a807f7-3865-4ec7-9af1-5f447e70423b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.199328] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.199520] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.199520] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.199670] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.200043] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.200043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.200043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.200295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.200295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.200405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.203594] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.203594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.203594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.203594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.203594] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.203594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.203594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.203594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.203594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.203594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.203594] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('605734aa-d0fb-486b-9d2a-22c70d9dd0ea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.308306] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.308638] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.308801] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.309139] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.309346] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.309706] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.310009] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.310211] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.310509] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.310730] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.311289] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c80fb398-76b1-47f9-8bb6-a122061a01d6 already deleted. [ 614.311666] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.329482] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-279 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.329912] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-279" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.330167] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-279" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.330622] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-279" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.331676] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.332110] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.332365] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.332740] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.333030] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.333361] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.333656] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 614.333896] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 614.335256] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 614.335548] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.335548] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 614.336207] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.359428] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 614.359428] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 614.359428] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 614.359428] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-279" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.359766] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-045512ee-e26c-4ea2-9dfa-e5f3a2e60088 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.359938] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-045512ee-e26c-4ea2-9dfa-e5f3a2e60088" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.359938] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-045512ee-e26c-4ea2-9dfa-e5f3a2e60088" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.360424] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-045512ee-e26c-4ea2-9dfa-e5f3a2e60088" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.360424] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('045512ee-e26c-4ea2-9dfa-e5f3a2e60088',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.426225] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.426225] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.426373] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.426531] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.426633] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.426969] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.427164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.427233] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.427398] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.427472] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.427828] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a807f7-3865-4ec7-9af1-5f447e70423b is going to be updated. [ 614.477733] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.477931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.477980] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.478250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.478400] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.502433] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a807f7-3865-4ec7-9af1-5f447e70423b in Status: IN_PROGRESS for 2s [ 614.609170] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: SUCCESS [ 614.609170] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.609516] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.610297] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.610549] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.610676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.610749] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.610927] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.611045] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.611124] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.707906] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 605734aa-d0fb-486b-9d2a-22c70d9dd0ea: rpc.has_security_group_logging(os_id): False [ 614.730025] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.730025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.730025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.730025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.730025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.730025] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.730025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.730025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.730025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.730025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.730025] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.730025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.730025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.730025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.730025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.730880] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.730880] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.730880] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.731270] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.731910] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.732148] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea is going to be created. [ 614.800183] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.800183] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.800183] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.800183] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.800183] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.817566] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea in Status: IN_PROGRESS for 2s [ 614.866019] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.866311] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.869421] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.869421] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.869421] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.869421] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 045512ee-e26c-4ea2-9dfa-e5f3a2e60088 not found, creating... [ 614.869421] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.869421] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.869421] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.869421] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.869421] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.869421] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.869898] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.871870] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.872161] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.873420] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.873420] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 045512ee-e26c-4ea2-9dfa-e5f3a2e60088 is going to be created. [ 614.921828] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.922543] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.922543] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.922858] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.923211] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.923558] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-045512ee-e26c-4ea2-9dfa-e5f3a2e60088" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.114106] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.182370] env[66994]: INFO networking_nsxv3.common.synchronization [req-365f8051-d137-4331-b7cd-65b09e0512c0 req-ed56f611-1db2-443a-97ab-bcc74269c05f tempest-ServerDiagnosticsNegativeTest-1360381424 tempest-ServerDiagnosticsNegativeTest-1360381424-project-member] Enqueued Resource ID: 841e623a-3249-4bd3-878a-817068626c8a with Priority: HIGHEST for action security_group_members [ 615.183300] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841e623a-3249-4bd3-878a-817068626c8a with Priority: HIGHEST for action security_group_members [ 615.183652] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-841e623a-3249-4bd3-878a-817068626c8a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.183797] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.183869] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.184113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.184302] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.184402] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.184456] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.184628] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.184746] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.184963] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('841e623a-3249-4bd3-878a-817068626c8a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.618019] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.652503] env[66994]: INFO networking_nsxv3.common.synchronization [req-f9aea3e7-237d-4a43-85b6-7a200fb6cb61 req-cb4f4b91-66e3-42ee-9a6e-30073d9cc8bc service nova] Enqueued Resource ID: c80fb398-76b1-47f9-8bb6-a122061a01d6 with Priority: HIGHEST for action security_group_rules [ 615.652503] env[66994]: INFO networking_nsxv3.common.synchronization [req-f9aea3e7-237d-4a43-85b6-7a200fb6cb61 req-cb4f4b91-66e3-42ee-9a6e-30073d9cc8bc service nova] Enqueued Resource ID: c80fb398-76b1-47f9-8bb6-a122061a01d6 with Priority: HIGHEST for action security_group_members [ 615.652503] env[66994]: INFO networking_nsxv3.common.synchronization [req-f9aea3e7-237d-4a43-85b6-7a200fb6cb61 req-cb4f4b91-66e3-42ee-9a6e-30073d9cc8bc service nova] Enqueued Resource ID: 045512ee-e26c-4ea2-9dfa-e5f3a2e60088 with Priority: HIGHEST for action port [ 615.652503] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c80fb398-76b1-47f9-8bb6-a122061a01d6 with Priority: HIGHEST for action security_group_rules [ 615.652503] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c80fb398-76b1-47f9-8bb6-a122061a01d6 with Priority: HIGHEST for action security_group_members [ 615.652503] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 045512ee-e26c-4ea2-9dfa-e5f3a2e60088 with Priority: HIGHEST for action port [ 615.652503] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c80fb398-76b1-47f9-8bb6-a122061a01d6 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.652503] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.652503] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.653444] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.654155] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c80fb398-76b1-47f9-8bb6-a122061a01d6',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.656315] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-c80fb398-76b1-47f9-8bb6-a122061a01d6 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.656640] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.656990] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.659024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.659024] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.659024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.659024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.659024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.659024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.659024] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c80fb398-76b1-47f9-8bb6-a122061a01d6',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.662126] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-045512ee-e26c-4ea2-9dfa-e5f3a2e60088 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.662471] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-045512ee-e26c-4ea2-9dfa-e5f3a2e60088" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.662698] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-045512ee-e26c-4ea2-9dfa-e5f3a2e60088" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.665108] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-045512ee-e26c-4ea2-9dfa-e5f3a2e60088" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.665108] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('045512ee-e26c-4ea2-9dfa-e5f3a2e60088',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.690028] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.690028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.690028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.690028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.690028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.690028] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.690028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.690028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.690028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.690028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.690028] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841e623a-3249-4bd3-878a-817068626c8a is going to be updated. [ 615.724910] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.725112] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.725156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.725347] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.725524] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.739917] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841e623a-3249-4bd3-878a-817068626c8a in Status: IN_PROGRESS for 2s [ 615.969013] env[66994]: INFO networking_nsxv3.common.synchronization [req-79c4759d-f67b-4bae-821f-8d64292f848f req-b3cddd91-c9fb-4ab4-8987-7e189ed44de1 tempest-VolumesAssistedSnapshotsTest-1112260893 tempest-VolumesAssistedSnapshotsTest-1112260893-project-member] Enqueued Resource ID: dbf01905-0f34-4b82-885d-141b364fdeab with Priority: HIGHEST for action security_group_members [ 615.969847] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf01905-0f34-4b82-885d-141b364fdeab with Priority: HIGHEST for action security_group_members [ 615.970351] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf01905-0f34-4b82-885d-141b364fdeab taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.970563] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.970989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.971096] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.971376] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.971540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.971766] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.972031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.972185] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.972449] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbf01905-0f34-4b82-885d-141b364fdeab',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.062151] env[66994]: INFO networking_nsxv3.common.synchronization [None req-c208a95b-c171-4624-8571-609e674e6b65 tempest-ServersWithSpecificFlavorTestJSON-500627254 tempest-ServersWithSpecificFlavorTestJSON-500627254-project-member] Enqueued Resource ID: a6612b52-6412-47ab-8918-14b6b8bca0cb with Priority: HIGHEST for action security_group_rules [ 616.064325] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6612b52-6412-47ab-8918-14b6b8bca0cb with Priority: HIGHEST for action security_group_rules [ 616.071427] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6612b52-6412-47ab-8918-14b6b8bca0cb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.071427] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.071427] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.071427] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.071427] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6612b52-6412-47ab-8918-14b6b8bca0cb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.120661] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.120661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.120661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.120661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.120661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.120661] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 is going to be updated. [ 616.157587] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-c80fb398-76b1-47f9-8bb6-a122061a01d6 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.157587] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.166515] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c80fb398-76b1-47f9-8bb6-a122061a01d6',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.169272] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 045512ee-e26c-4ea2-9dfa-e5f3a2e60088 with status ACTIVE [ 616.169552] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.169680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.169765] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.169959] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.170340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.170340] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.170340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.170588] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.170622] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.170775] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.170911] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.170999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.171090] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.171244] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.171319] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.171656] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 045512ee-e26c-4ea2-9dfa-e5f3a2e60088 is going to be updated. [ 616.184653] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.184653] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.184653] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.185010] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.185233] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.200436] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: IN_PROGRESS for 2s [ 616.228600] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.228815] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.228815] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.229037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.229179] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.229342] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-045512ee-e26c-4ea2-9dfa-e5f3a2e60088" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.464952] env[66994]: INFO networking_nsxv3.common.synchronization [None req-4b956c5d-ea27-4eff-960e-342e313928f6 tempest-ServersWithSpecificFlavorTestJSON-500627254 tempest-ServersWithSpecificFlavorTestJSON-500627254-project-member] Enqueued Resource ID: a6612b52-6412-47ab-8918-14b6b8bca0cb with Priority: HIGHEST for action security_group_rules [ 616.465569] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6612b52-6412-47ab-8918-14b6b8bca0cb with Priority: HIGHEST for action security_group_rules [ 616.465881] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6612b52-6412-47ab-8918-14b6b8bca0cb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.465985] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.471272] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-506 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.471509] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-506" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.471664] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-506" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.472036] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-506" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.472345] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.472623] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.472781] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.473037] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.473211] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.473435] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.473573] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.473727] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.473854] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.473981] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.474122] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.474304] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.475845] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.476104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.476255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.476835] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.476835] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.476835] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.476835] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.477020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.477376] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.477376] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.477478] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbf01905-0f34-4b82-885d-141b364fdeab already deleted. [ 616.477991] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.496423] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.497755] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 616.497755] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.497755] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-506" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.497755] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-331e7016-0f49-437d-8921-137c6bc1e9d4 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.497755] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-331e7016-0f49-437d-8921-137c6bc1e9d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.497755] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-331e7016-0f49-437d-8921-137c6bc1e9d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.498663] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-331e7016-0f49-437d-8921-137c6bc1e9d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.498663] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('331e7016-0f49-437d-8921-137c6bc1e9d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.513777] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a807f7-3865-4ec7-9af1-5f447e70423b in Status: SUCCESS [ 616.513777] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a807f7-3865-4ec7-9af1-5f447e70423b deletion is rescheduled due to dependency. [ 616.513777] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.590732] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.590732] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.590732] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.590982] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.590982] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.590982] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6612b52-6412-47ab-8918-14b6b8bca0cb already deleted. [ 616.591108] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.591222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.591381] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.591463] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6612b52-6412-47ab-8918-14b6b8bca0cb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.670024] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c80fb398-76b1-47f9-8bb6-a122061a01d6',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.830211] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea in Status: SUCCESS [ 616.830558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.002628] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.002628] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.002628] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.002628] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.002628] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.002628] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 331e7016-0f49-437d-8921-137c6bc1e9d4 not found, creating... [ 617.002628] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.002628] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.002628] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.003596] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.003596] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.003596] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.003596] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.003596] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.003596] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.003886] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.003928] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 331e7016-0f49-437d-8921-137c6bc1e9d4 is going to be created. [ 617.027294] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.027657] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.027880] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.028305] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.028676] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.029048] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-331e7016-0f49-437d-8921-137c6bc1e9d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.123899] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.124384] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.124384] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.125257] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.125257] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.125257] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6612b52-6412-47ab-8918-14b6b8bca0cb already deleted. [ 617.125257] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.171934] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.172215] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.172331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.172664] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.172801] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.173069] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c80fb398-76b1-47f9-8bb6-a122061a01d6 is going to be created. [ 617.200660] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.200754] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.204022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.204022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.204022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.216552] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c80fb398-76b1-47f9-8bb6-a122061a01d6 in Status: UNINITIALIZED for 2s [ 617.749763] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841e623a-3249-4bd3-878a-817068626c8a in Status: SUCCESS [ 617.749763] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841e623a-3249-4bd3-878a-817068626c8a deletion is rescheduled due to dependency. [ 617.749763] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.783337] env[66994]: INFO networking_nsxv3.common.synchronization [req-79c4759d-f67b-4bae-821f-8d64292f848f req-83b3fb11-8a63-49fe-ad55-76f17c5a7106 service nova] Enqueued Resource ID: dbf01905-0f34-4b82-885d-141b364fdeab with Priority: HIGHEST for action security_group_rules [ 617.783572] env[66994]: INFO networking_nsxv3.common.synchronization [req-79c4759d-f67b-4bae-821f-8d64292f848f req-83b3fb11-8a63-49fe-ad55-76f17c5a7106 service nova] Enqueued Resource ID: dbf01905-0f34-4b82-885d-141b364fdeab with Priority: HIGHEST for action security_group_members [ 617.783720] env[66994]: INFO networking_nsxv3.common.synchronization [req-79c4759d-f67b-4bae-821f-8d64292f848f req-83b3fb11-8a63-49fe-ad55-76f17c5a7106 service nova] Enqueued Resource ID: 331e7016-0f49-437d-8921-137c6bc1e9d4 with Priority: HIGHEST for action port [ 617.784386] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf01905-0f34-4b82-885d-141b364fdeab with Priority: HIGHEST for action security_group_rules [ 617.784386] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf01905-0f34-4b82-885d-141b364fdeab with Priority: HIGHEST for action security_group_members [ 617.784608] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331e7016-0f49-437d-8921-137c6bc1e9d4 with Priority: HIGHEST for action port [ 617.784761] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbf01905-0f34-4b82-885d-141b364fdeab taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.784906] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.784983] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.786562] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.786562] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbf01905-0f34-4b82-885d-141b364fdeab',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.788403] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf01905-0f34-4b82-885d-141b364fdeab taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.788403] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.788403] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.791403] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.791608] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.791720] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.791816] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.791960] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.792056] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.792148] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbf01905-0f34-4b82-885d-141b364fdeab',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.793123] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-331e7016-0f49-437d-8921-137c6bc1e9d4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.793257] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-331e7016-0f49-437d-8921-137c6bc1e9d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.793303] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-331e7016-0f49-437d-8921-137c6bc1e9d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.793456] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-331e7016-0f49-437d-8921-137c6bc1e9d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.793547] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('331e7016-0f49-437d-8921-137c6bc1e9d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.213739] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: SUCCESS [ 618.214319] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.214424] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.214945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.215774] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.215973] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.216092] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.216382] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.216509] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.216724] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.216859] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.296456] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf01905-0f34-4b82-885d-141b364fdeab taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.296661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.296765] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbf01905-0f34-4b82-885d-141b364fdeab',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.297652] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 331e7016-0f49-437d-8921-137c6bc1e9d4 with status ACTIVE [ 618.297842] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.297973] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.298081] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.298246] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.298342] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.298510] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.298653] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.298653] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.306167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.306167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.306167] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.306167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.306167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.306167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.306167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.306167] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 331e7016-0f49-437d-8921-137c6bc1e9d4 is going to be updated. [ 618.329703] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.330120] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.330120] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.330289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.330289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.330500] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-331e7016-0f49-437d-8921-137c6bc1e9d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.720544] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.722059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.722059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.722059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.722059] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.722059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.722059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.722059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.722059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.722561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.722561] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.722742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.722969] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.723176] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.723367] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.723508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.723610] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.723819] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.723961] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.724100] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.724235] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.807394] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbf01905-0f34-4b82-885d-141b364fdeab',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.228794] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5dbec57c-866e-4292-acf4-6de3635c21b3: rpc.has_security_group_logging(os_id): False [ 619.228794] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c80fb398-76b1-47f9-8bb6-a122061a01d6 in Status: SUCCESS [ 619.229175] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.229479] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.229811] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.230143] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.230939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.231257] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.232359] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.232574] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.232791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.232966] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c80fb398-76b1-47f9-8bb6-a122061a01d6',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.255039] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.255039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.255039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.255039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.255039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.255039] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.255039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.255039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.255039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.255039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.255039] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.255997] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.257341] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.258141] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.258676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.261019] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.261019] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.261019] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.261019] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.261019] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.261019] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 is going to be updated. [ 619.311666] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.311847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.311968] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.312189] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.312318] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.312437] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbf01905-0f34-4b82-885d-141b364fdeab is going to be created. [ 619.415203] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.415203] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.415203] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.415203] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.415404] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.428906] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbf01905-0f34-4b82-885d-141b364fdeab in Status: UNINITIALIZED for 2s [ 619.450617] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.450955] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.450955] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.452069] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.452069] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.469290] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: IN_PROGRESS for 2s [ 619.737805] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-c80fb398-76b1-47f9-8bb6-a122061a01d6 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.738013] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.738188] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.738320] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.738500] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.738588] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.738652] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.738803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.738888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.738972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.739131] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-c80fb398-76b1-47f9-8bb6-a122061a01d6 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.739222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.739278] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.739422] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.739551] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.739664] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.739732] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.739976] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.740070] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.740154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.740242] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c80fb398-76b1-47f9-8bb6-a122061a01d6',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.988335] env[66994]: INFO networking_nsxv3.common.synchronization [None req-8658a952-91b0-4774-8c51-7a3af7337d98 None None] Enqueued Resource ID: e3e07314-3a5e-42d2-9388-43d448b8140e with Priority: HIGHEST for action port [ 619.988978] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3e07314-3a5e-42d2-9388-43d448b8140e with Priority: HIGHEST for action port [ 619.989586] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3e07314-3a5e-42d2-9388-43d448b8140e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.989760] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3e07314-3a5e-42d2-9388-43d448b8140e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.989904] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3e07314-3a5e-42d2-9388-43d448b8140e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.990331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3e07314-3a5e-42d2-9388-43d448b8140e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.990458] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3e07314-3a5e-42d2-9388-43d448b8140e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.242443] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c80fb398-76b1-47f9-8bb6-a122061a01d6: rpc.has_security_group_logging(os_id): False [ 620.266416] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.266619] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.266702] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.266864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.266999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.267169] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.267272] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.267336] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.267495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.267573] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.267767] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.267860] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.267915] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.268067] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.268142] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.268329] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.268418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.268514] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.268969] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.268969] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.268969] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c80fb398-76b1-47f9-8bb6-a122061a01d6 is going to be created. [ 620.357779] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.358052] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.358169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.358504] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.358789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.373436] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c80fb398-76b1-47f9-8bb6-a122061a01d6 in Status: IN_PROGRESS for 2s [ 620.495304] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3e07314-3a5e-42d2-9388-43d448b8140e [ 620.495304] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.495304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.495304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.495304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.495304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.495304] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3e07314-3a5e-42d2-9388-43d448b8140e already deleted. [ 620.495304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3e07314-3a5e-42d2-9388-43d448b8140e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.443429] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbf01905-0f34-4b82-885d-141b364fdeab in Status: SUCCESS [ 621.443827] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.447024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.447024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.447024] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.447024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.447024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.447024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.447024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.447024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.447024] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbf01905-0f34-4b82-885d-141b364fdeab',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.485690] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: SUCCESS [ 621.485912] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.948853] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbf01905-0f34-4b82-885d-141b364fdeab',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.388984] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c80fb398-76b1-47f9-8bb6-a122061a01d6 in Status: SUCCESS [ 622.389491] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.455040] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbf01905-0f34-4b82-885d-141b364fdeab: rpc.has_security_group_logging(os_id): False [ 622.484365] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.484456] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.484696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.484803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.484871] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.485149] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.485263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.485355] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.485546] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.485739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.485739] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbf01905-0f34-4b82-885d-141b364fdeab is going to be created. [ 622.589409] env[66994]: INFO networking_nsxv3.common.synchronization [req-94f1e02a-d550-489a-af5f-6455a5cd2645 req-7b62ba16-db85-49b6-9940-4525a38c5c03 tempest-ImagesOneServerNegativeTestJSON-1432587522 tempest-ImagesOneServerNegativeTestJSON-1432587522-project-member] Enqueued Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_members [ 622.589409] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_members [ 622.590260] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-11c0b684-9731-4046-89ad-f4bf7b2168d4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.590442] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.590735] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.591160] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.591940] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.592121] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.592188] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.592392] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.592497] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.592667] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.628158] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.628158] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.628158] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.628158] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.628158] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.650115] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbf01905-0f34-4b82-885d-141b364fdeab in Status: IN_PROGRESS for 2s [ 622.752060] env[66994]: INFO networking_nsxv3.common.synchronization [None req-0a3f23e9-535f-4c6a-9315-202f244038e8 None None] Enqueued Resource ID: 60e5cd40-092b-4aa4-884c-b3ace1418062 with Priority: HIGHEST for action port [ 622.753057] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60e5cd40-092b-4aa4-884c-b3ace1418062 with Priority: HIGHEST for action port [ 622.753437] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-60e5cd40-092b-4aa4-884c-b3ace1418062 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.753624] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60e5cd40-092b-4aa4-884c-b3ace1418062" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.753784] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60e5cd40-092b-4aa4-884c-b3ace1418062" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.754269] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60e5cd40-092b-4aa4-884c-b3ace1418062" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.754269] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60e5cd40-092b-4aa4-884c-b3ace1418062',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.097523] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.097684] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.097761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.098040] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.098113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.098307] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.098409] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.098472] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.098624] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.098704] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.098786] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 already deleted. [ 623.099091] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.257847] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60e5cd40-092b-4aa4-884c-b3ace1418062 [ 623.257847] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.257847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.257847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.257847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.257847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.257847] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60e5cd40-092b-4aa4-884c-b3ace1418062 already deleted. [ 623.257847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60e5cd40-092b-4aa4-884c-b3ace1418062" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.626029] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-767 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.626355] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-767" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.626562] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-767" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.626978] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-767" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.627491] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.627762] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.628151] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.628191] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.628327] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.628523] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.628628] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.628728] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.628827] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.629013] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.629125] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.629158] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.649353] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.649668] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 623.649785] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.649898] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-767" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.650233] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-f3993c9c-3fb2-4f97-8368-f0f0da35e6f4 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.650402] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-f3993c9c-3fb2-4f97-8368-f0f0da35e6f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.650532] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-f3993c9c-3fb2-4f97-8368-f0f0da35e6f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.650910] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-f3993c9c-3fb2-4f97-8368-f0f0da35e6f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.651321] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3993c9c-3fb2-4f97-8368-f0f0da35e6f4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.155583] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.155871] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.155981] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.156857] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.156998] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.157209] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port f3993c9c-3fb2-4f97-8368-f0f0da35e6f4 not found, creating... [ 624.157736] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.157922] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.158164] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.158426] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.158426] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.158720] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.159067] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.159067] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.159195] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.159340] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.159447] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: f3993c9c-3fb2-4f97-8368-f0f0da35e6f4 is going to be created. [ 624.182489] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.183039] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.183039] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.183242] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.183440] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.183657] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-f3993c9c-3fb2-4f97-8368-f0f0da35e6f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.667295] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbf01905-0f34-4b82-885d-141b364fdeab in Status: SUCCESS [ 624.667295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.969204] env[66994]: INFO networking_nsxv3.common.synchronization [req-94f1e02a-d550-489a-af5f-6455a5cd2645 req-558af456-a35c-475c-b0da-217661ee34f8 service nova] Enqueued Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_rules [ 624.969335] env[66994]: INFO networking_nsxv3.common.synchronization [req-94f1e02a-d550-489a-af5f-6455a5cd2645 req-558af456-a35c-475c-b0da-217661ee34f8 service nova] Enqueued Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_members [ 624.969409] env[66994]: INFO networking_nsxv3.common.synchronization [req-94f1e02a-d550-489a-af5f-6455a5cd2645 req-558af456-a35c-475c-b0da-217661ee34f8 service nova] Enqueued Resource ID: f3993c9c-3fb2-4f97-8368-f0f0da35e6f4 with Priority: HIGHEST for action port [ 624.969707] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_rules [ 624.969905] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_members [ 624.971162] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3993c9c-3fb2-4f97-8368-f0f0da35e6f4 with Priority: HIGHEST for action port [ 624.973166] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11c0b684-9731-4046-89ad-f4bf7b2168d4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.973166] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.973166] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.975323] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.976024] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.977227] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-11c0b684-9731-4046-89ad-f4bf7b2168d4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.978483] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.978483] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.978720] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.979812] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.979812] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.979812] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.981182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.981329] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.981474] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.982844] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3993c9c-3fb2-4f97-8368-f0f0da35e6f4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.982844] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3993c9c-3fb2-4f97-8368-f0f0da35e6f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.983296] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3993c9c-3fb2-4f97-8368-f0f0da35e6f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.985539] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3993c9c-3fb2-4f97-8368-f0f0da35e6f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.985539] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3993c9c-3fb2-4f97-8368-f0f0da35e6f4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.485919] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-11c0b684-9731-4046-89ad-f4bf7b2168d4 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.486150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.486444] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.487363] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3993c9c-3fb2-4f97-8368-f0f0da35e6f4 with status ACTIVE [ 625.488087] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.488087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.488087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.488087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.488087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.488410] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.488410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.488410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.488625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.488734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.488952] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.490561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.490561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.490561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.490561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.490561] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3993c9c-3fb2-4f97-8368-f0f0da35e6f4 is going to be updated. [ 625.532409] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.532703] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.532703] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.533435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.533435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.533435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3993c9c-3fb2-4f97-8368-f0f0da35e6f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.566126] env[66994]: INFO networking_nsxv3.common.synchronization [None req-5a01f444-756a-4311-94b3-f0428901568e None None] Enqueued Resource ID: 4df5e519-512b-4db8-8ee1-86c0498fdcff with Priority: HIGHEST for action port [ 625.567713] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df5e519-512b-4db8-8ee1-86c0498fdcff with Priority: HIGHEST for action port [ 625.568270] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-4df5e519-512b-4db8-8ee1-86c0498fdcff taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.568413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4df5e519-512b-4db8-8ee1-86c0498fdcff" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.568484] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4df5e519-512b-4db8-8ee1-86c0498fdcff" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.568818] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4df5e519-512b-4db8-8ee1-86c0498fdcff" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.568906] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4df5e519-512b-4db8-8ee1-86c0498fdcff',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.747786] env[66994]: INFO networking_nsxv3.common.synchronization [req-530f16ff-6d22-4d9b-90b2-471f17c90f05 req-3d874cdb-3d8e-4a9f-b7cc-da8fa2ac3190 tempest-FloatingIPsAssociationNegativeTestJSON-2031438366 tempest-FloatingIPsAssociationNegativeTestJSON-2031438366-project-member] Enqueued Resource ID: 3ea9c700-dac6-4282-90b7-8b85af493263 with Priority: HIGHEST for action security_group_members [ 625.748623] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ea9c700-dac6-4282-90b7-8b85af493263 with Priority: HIGHEST for action security_group_members [ 625.749142] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ea9c700-dac6-4282-90b7-8b85af493263 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.749319] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.749319] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.749586] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.749814] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.749953] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.750048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.750237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.750373] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.750490] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ea9c700-dac6-4282-90b7-8b85af493263',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.996277] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.074606] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4df5e519-512b-4db8-8ee1-86c0498fdcff [ 626.074606] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.074606] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.074606] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.074606] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.074606] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.074606] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4df5e519-512b-4db8-8ee1-86c0498fdcff already deleted. [ 626.074606] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4df5e519-512b-4db8-8ee1-86c0498fdcff" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.253738] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.253873] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.253982] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.255119] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.255899] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.255899] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.256121] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.256121] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.256360] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.256501] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.256675] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ea9c700-dac6-4282-90b7-8b85af493263 already deleted. [ 626.256808] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.448037] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-549 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.448292] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-549" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.448388] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-549" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.448748] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-549" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.449164] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.449340] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.449477] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.449726] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.449869] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.450084] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.450179] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 626.450280] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 626.450394] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 626.450476] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.450602] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 626.450735] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 626.475292] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 626.475680] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 626.475680] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 626.475680] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-549" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.475990] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-11e72cc4-023b-4aab-9a03-920b7e020571 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.476443] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-11e72cc4-023b-4aab-9a03-920b7e020571" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.476443] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-11e72cc4-023b-4aab-9a03-920b7e020571" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.476675] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-11e72cc4-023b-4aab-9a03-920b7e020571" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.476981] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11e72cc4-023b-4aab-9a03-920b7e020571',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.501213] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.501400] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.503016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.503016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.503016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.503016] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 is going to be created. [ 626.532257] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.532257] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.532257] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.532546] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.532580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.548240] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 in Status: UNINITIALIZED for 2s [ 626.981940] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.982231] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.982272] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.982588] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.982677] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.982872] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 11e72cc4-023b-4aab-9a03-920b7e020571 not found, creating... [ 626.983151] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.983307] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.983417] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.983644] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.983779] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.984088] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.984244] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.984353] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.984555] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.984683] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.984821] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 11e72cc4-023b-4aab-9a03-920b7e020571 is going to be created. [ 627.012108] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.012108] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.012108] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.012108] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.012108] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.012108] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-11e72cc4-023b-4aab-9a03-920b7e020571" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.689514] env[66994]: INFO networking_nsxv3.common.synchronization [None req-9a9cb2db-20fb-4475-b2be-819336421f7b None None] Enqueued Resource ID: 024676f3-f116-46ff-8ae9-1a2e225a97bc with Priority: HIGHEST for action port [ 627.690253] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 024676f3-f116-46ff-8ae9-1a2e225a97bc with Priority: HIGHEST for action port [ 627.690900] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-024676f3-f116-46ff-8ae9-1a2e225a97bc taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.690900] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-024676f3-f116-46ff-8ae9-1a2e225a97bc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.690900] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-024676f3-f116-46ff-8ae9-1a2e225a97bc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.691269] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-024676f3-f116-46ff-8ae9-1a2e225a97bc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.691373] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('024676f3-f116-46ff-8ae9-1a2e225a97bc',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.718837] env[66994]: INFO networking_nsxv3.common.synchronization [req-530f16ff-6d22-4d9b-90b2-471f17c90f05 req-72aa3795-1b65-4a35-9928-91d8fcd7ca35 service nova] Enqueued Resource ID: 3ea9c700-dac6-4282-90b7-8b85af493263 with Priority: HIGHEST for action security_group_rules [ 627.719032] env[66994]: INFO networking_nsxv3.common.synchronization [req-530f16ff-6d22-4d9b-90b2-471f17c90f05 req-72aa3795-1b65-4a35-9928-91d8fcd7ca35 service nova] Enqueued Resource ID: 3ea9c700-dac6-4282-90b7-8b85af493263 with Priority: HIGHEST for action security_group_members [ 627.719173] env[66994]: INFO networking_nsxv3.common.synchronization [req-530f16ff-6d22-4d9b-90b2-471f17c90f05 req-72aa3795-1b65-4a35-9928-91d8fcd7ca35 service nova] Enqueued Resource ID: 11e72cc4-023b-4aab-9a03-920b7e020571 with Priority: HIGHEST for action port [ 627.719829] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ea9c700-dac6-4282-90b7-8b85af493263 with Priority: HIGHEST for action security_group_rules [ 627.719965] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ea9c700-dac6-4282-90b7-8b85af493263 with Priority: HIGHEST for action security_group_members [ 627.719965] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11e72cc4-023b-4aab-9a03-920b7e020571 with Priority: HIGHEST for action port [ 627.723232] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ea9c700-dac6-4282-90b7-8b85af493263 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.723232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.723232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.723232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.723232] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ea9c700-dac6-4282-90b7-8b85af493263',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.723232] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ea9c700-dac6-4282-90b7-8b85af493263 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.723232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.723232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.723232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.723232] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.723232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.723232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.723232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.723232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.723232] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ea9c700-dac6-4282-90b7-8b85af493263',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.725170] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-11e72cc4-023b-4aab-9a03-920b7e020571 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.725340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11e72cc4-023b-4aab-9a03-920b7e020571" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.725639] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11e72cc4-023b-4aab-9a03-920b7e020571" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.725877] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11e72cc4-023b-4aab-9a03-920b7e020571" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.726578] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11e72cc4-023b-4aab-9a03-920b7e020571',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.195816] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 024676f3-f116-46ff-8ae9-1a2e225a97bc [ 628.196166] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.196299] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.196527] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.196817] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.197319] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.197319] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:024676f3-f116-46ff-8ae9-1a2e225a97bc already deleted. [ 628.197477] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-024676f3-f116-46ff-8ae9-1a2e225a97bc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.228545] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ea9c700-dac6-4282-90b7-8b85af493263 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.228787] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.228854] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ea9c700-dac6-4282-90b7-8b85af493263',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.232959] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 11e72cc4-023b-4aab-9a03-920b7e020571 with status ACTIVE [ 628.233085] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.233204] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.233249] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.236601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.236601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.236601] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.236601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.236601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.236601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.236601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.236601] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.236601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.236601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.236601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.236601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.236601] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 11e72cc4-023b-4aab-9a03-920b7e020571 is going to be updated. [ 628.262020] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.262020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.262020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.262020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.262020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.262020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11e72cc4-023b-4aab-9a03-920b7e020571" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.559486] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 in Status: SUCCESS [ 628.560951] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.560951] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.560951] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.560951] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.560951] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.560951] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.561335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.561335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.561335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.561420] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.732927] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ea9c700-dac6-4282-90b7-8b85af493263',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.064404] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-11c0b684-9731-4046-89ad-f4bf7b2168d4 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.064404] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.064404] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.065224] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.065224] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.065224] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.065224] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.065906] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.066121] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.066207] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.066381] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-11c0b684-9731-4046-89ad-f4bf7b2168d4 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.066482] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.066545] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.066722] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.067658] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.067658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.067658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.067658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.067658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.067658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.067658] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.236606] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.237128] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.237128] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.237128] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.237128] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.237431] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ea9c700-dac6-4282-90b7-8b85af493263 is going to be created. [ 629.254457] env[66994]: INFO networking_nsxv3.common.synchronization [req-578c4c6c-2ff0-48e2-aae1-64896bb43555 req-1b8fb6cc-4d58-42c8-9282-9e8cb1f1eb61 tempest-TenantUsagesTestJSON-1537662545 tempest-TenantUsagesTestJSON-1537662545-project-member] Enqueued Resource ID: 2f159d71-0083-4a40-882f-2a28e3868c96 with Priority: HIGHEST for action security_group_members [ 629.254838] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f159d71-0083-4a40-882f-2a28e3868c96 with Priority: HIGHEST for action security_group_members [ 629.255835] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f159d71-0083-4a40-882f-2a28e3868c96 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.255835] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.255835] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.256189] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.256405] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.256570] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.256625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.256786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.256942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.257084] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f159d71-0083-4a40-882f-2a28e3868c96',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.263023] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.263295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.263295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.263506] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.263876] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.279737] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ea9c700-dac6-4282-90b7-8b85af493263 in Status: UNINITIALIZED for 2s [ 629.570628] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11c0b684-9731-4046-89ad-f4bf7b2168d4: rpc.has_security_group_logging(os_id): False [ 629.604138] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.604382] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.604435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.604692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.604806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.605080] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.605202] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.605270] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.605446] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.605521] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.605709] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.605850] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.605850] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.605986] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.606078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.606281] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.606405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.606482] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.606559] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.606628] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.606714] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 is going to be created. [ 629.676016] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.676016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.676016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.676016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.676016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.687522] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 in Status: IN_PROGRESS for 2s [ 629.762196] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.762368] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.762434] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.766113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.766113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.766113] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.766113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.766113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.766113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.766113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.766113] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f159d71-0083-4a40-882f-2a28e3868c96 is going to be updated. [ 629.840809] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.841014] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.841220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.841274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.841708] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.857319] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f159d71-0083-4a40-882f-2a28e3868c96 in Status: IN_PROGRESS for 2s [ 629.874018] env[66994]: INFO networking_nsxv3.common.synchronization [req-574fd5eb-8dd6-472b-9c06-b5f7e42fcf32 req-dbd8cae3-2b30-407d-bb2d-c8238d3ecf25 tempest-ServersWithSpecificFlavorTestJSON-500627254 tempest-ServersWithSpecificFlavorTestJSON-500627254-project-member] Enqueued Resource ID: a6612b52-6412-47ab-8918-14b6b8bca0cb with Priority: HIGHEST for action security_group_members [ 629.875190] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6612b52-6412-47ab-8918-14b6b8bca0cb with Priority: HIGHEST for action security_group_members [ 629.875665] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6612b52-6412-47ab-8918-14b6b8bca0cb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.875914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.875914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.876299] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.876581] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.876700] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.876787] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.877014] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.877161] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.877626] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6612b52-6412-47ab-8918-14b6b8bca0cb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.382062] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.382415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.382415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.382779] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.382874] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.383108] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.383235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.383435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.383546] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.383660] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.383871] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6612b52-6412-47ab-8918-14b6b8bca0cb already deleted. [ 630.383991] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.412408] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-822 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.412727] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-822" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.412867] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-822" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.415472] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-822" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.415472] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.415472] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.415778] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.416364] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.416619] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.417194] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.417194] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 630.417303] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 630.417401] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 630.417535] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.417673] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 630.417850] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 630.446770] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 630.446949] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 630.447086] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 630.447262] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-822" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.447610] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-b96e2823-f053-4225-86e4-54be30d3ccca taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.447821] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-b96e2823-f053-4225-86e4-54be30d3ccca" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.447998] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-b96e2823-f053-4225-86e4-54be30d3ccca" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.448352] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-b96e2823-f053-4225-86e4-54be30d3ccca" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.448561] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b96e2823-f053-4225-86e4-54be30d3ccca',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.951232] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.951462] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.951621] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.951930] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.952107] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.952265] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port b96e2823-f053-4225-86e4-54be30d3ccca not found, creating... [ 630.952571] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.952776] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.952892] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.953133] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.953294] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.953557] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.953726] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.953831] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.954034] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.954195] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.954418] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: b96e2823-f053-4225-86e4-54be30d3ccca is going to be created. [ 630.978063] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.978063] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.978063] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.978377] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.978377] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.978603] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-b96e2823-f053-4225-86e4-54be30d3ccca" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.296414] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ea9c700-dac6-4282-90b7-8b85af493263 in Status: SUCCESS [ 631.296823] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.297147] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.297427] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.297676] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.297799] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.297861] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.298101] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.298260] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.298335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.298387] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ea9c700-dac6-4282-90b7-8b85af493263',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.664695] env[66994]: INFO networking_nsxv3.common.synchronization [None req-c7c6b535-b220-4ad1-8d90-74d98eeb6545 None None] Enqueued Resource ID: 31ce391e-08d7-45e1-bdf7-d39d9e463aca with Priority: HIGHEST for action port [ 631.665934] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31ce391e-08d7-45e1-bdf7-d39d9e463aca with Priority: HIGHEST for action port [ 631.669204] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-31ce391e-08d7-45e1-bdf7-d39d9e463aca taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.669204] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31ce391e-08d7-45e1-bdf7-d39d9e463aca" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.669204] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31ce391e-08d7-45e1-bdf7-d39d9e463aca" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.669204] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31ce391e-08d7-45e1-bdf7-d39d9e463aca" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.669204] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31ce391e-08d7-45e1-bdf7-d39d9e463aca',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.702220] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 in Status: SUCCESS [ 631.702690] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.722742] env[66994]: INFO networking_nsxv3.common.synchronization [req-574fd5eb-8dd6-472b-9c06-b5f7e42fcf32 req-a7b38542-1452-4976-8d5e-4a92c02f3ce2 service nova] Enqueued Resource ID: a6612b52-6412-47ab-8918-14b6b8bca0cb with Priority: HIGHEST for action security_group_rules [ 631.723061] env[66994]: INFO networking_nsxv3.common.synchronization [req-574fd5eb-8dd6-472b-9c06-b5f7e42fcf32 req-a7b38542-1452-4976-8d5e-4a92c02f3ce2 service nova] Enqueued Resource ID: a6612b52-6412-47ab-8918-14b6b8bca0cb with Priority: HIGHEST for action security_group_members [ 631.723307] env[66994]: INFO networking_nsxv3.common.synchronization [req-574fd5eb-8dd6-472b-9c06-b5f7e42fcf32 req-a7b38542-1452-4976-8d5e-4a92c02f3ce2 service nova] Enqueued Resource ID: b96e2823-f053-4225-86e4-54be30d3ccca with Priority: HIGHEST for action port [ 631.724187] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6612b52-6412-47ab-8918-14b6b8bca0cb with Priority: HIGHEST for action security_group_rules [ 631.724407] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6612b52-6412-47ab-8918-14b6b8bca0cb with Priority: HIGHEST for action security_group_members [ 631.725651] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b96e2823-f053-4225-86e4-54be30d3ccca with Priority: HIGHEST for action port [ 631.726097] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6612b52-6412-47ab-8918-14b6b8bca0cb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.726813] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.726935] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.727260] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.727473] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6612b52-6412-47ab-8918-14b6b8bca0cb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.728798] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6612b52-6412-47ab-8918-14b6b8bca0cb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.728998] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.729108] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.729437] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.729671] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.729832] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.729936] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.730359] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.730422] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.730515] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6612b52-6412-47ab-8918-14b6b8bca0cb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.732308] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-b96e2823-f053-4225-86e4-54be30d3ccca taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.732433] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b96e2823-f053-4225-86e4-54be30d3ccca" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.732625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b96e2823-f053-4225-86e4-54be30d3ccca" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.732927] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b96e2823-f053-4225-86e4-54be30d3ccca" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.733163] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b96e2823-f053-4225-86e4-54be30d3ccca',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.802558] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ea9c700-dac6-4282-90b7-8b85af493263 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.802558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.802558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.802558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.802558] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.802558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.802558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.802558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.802558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.802558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.802558] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ea9c700-dac6-4282-90b7-8b85af493263 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.802558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.802558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.802558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.802558] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.802558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.803620] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.803620] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.803620] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.803620] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.803620] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ea9c700-dac6-4282-90b7-8b85af493263',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.867212] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f159d71-0083-4a40-882f-2a28e3868c96 in Status: SUCCESS [ 631.867401] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f159d71-0083-4a40-882f-2a28e3868c96 deletion is rescheduled due to dependency. [ 631.867519] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.172668] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31ce391e-08d7-45e1-bdf7-d39d9e463aca [ 632.173247] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.175411] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.175411] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.175411] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.175572] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.175572] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31ce391e-08d7-45e1-bdf7-d39d9e463aca already deleted. [ 632.175687] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31ce391e-08d7-45e1-bdf7-d39d9e463aca" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.236488] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6612b52-6412-47ab-8918-14b6b8bca0cb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.237820] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6612b52-6412-47ab-8918-14b6b8bca0cb taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.237820] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.237820] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b96e2823-f053-4225-86e4-54be30d3ccca with status ACTIVE [ 632.237820] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.237820] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.237820] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.238273] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.238273] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.238342] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.239219] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.239219] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.239219] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.239219] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.239219] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.239219] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.239505] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.243017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.243017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.243017] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b96e2823-f053-4225-86e4-54be30d3ccca is going to be updated. [ 632.266706] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.266829] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.266898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.267149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.267287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.267451] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b96e2823-f053-4225-86e4-54be30d3ccca" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.305754] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ea9c700-dac6-4282-90b7-8b85af493263: rpc.has_security_group_logging(os_id): False [ 632.327655] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.327655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.327655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.327655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.327655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.327655] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.327655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.327655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.328099] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.328099] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.328099] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.328285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.328285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.329280] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.329280] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.330087] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.330087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.330087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.330087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.330087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.330087] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ea9c700-dac6-4282-90b7-8b85af493263 is going to be created. [ 632.409247] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.409385] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.409484] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.409658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.409827] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.424492] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ea9c700-dac6-4282-90b7-8b85af493263 in Status: IN_PROGRESS for 2s [ 632.744202] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6612b52-6412-47ab-8918-14b6b8bca0cb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.246521] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.246712] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.246808] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.247114] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.247240] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.249954] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6612b52-6412-47ab-8918-14b6b8bca0cb is going to be created. [ 633.279391] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.279607] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.279607] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.279857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.280055] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.292311] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6612b52-6412-47ab-8918-14b6b8bca0cb in Status: UNINITIALIZED for 2s [ 633.829669] env[66994]: INFO networking_nsxv3.common.synchronization [None req-1a0e4f25-4a23-4b97-b980-dcac616ebe09 None None] Enqueued Resource ID: 84724a7c-0be4-4876-8b8a-1bb9a761ccbe with Priority: HIGHEST for action port [ 633.830449] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84724a7c-0be4-4876-8b8a-1bb9a761ccbe with Priority: HIGHEST for action port [ 633.830913] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-84724a7c-0be4-4876-8b8a-1bb9a761ccbe taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.831082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84724a7c-0be4-4876-8b8a-1bb9a761ccbe" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.831183] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84724a7c-0be4-4876-8b8a-1bb9a761ccbe" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.831996] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84724a7c-0be4-4876-8b8a-1bb9a761ccbe" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.831996] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84724a7c-0be4-4876-8b8a-1bb9a761ccbe',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.323242] env[66994]: INFO networking_nsxv3.common.synchronization [None req-6ad90e69-6d91-4b14-a422-b3ee19ac7c69 None None] Enqueued Resource ID: fd1e994a-7040-438e-8603-1e32b8410319 with Priority: HIGHEST for action port [ 634.323873] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd1e994a-7040-438e-8603-1e32b8410319 with Priority: HIGHEST for action port [ 634.324247] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd1e994a-7040-438e-8603-1e32b8410319 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.324393] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd1e994a-7040-438e-8603-1e32b8410319" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.324469] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd1e994a-7040-438e-8603-1e32b8410319" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.324731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd1e994a-7040-438e-8603-1e32b8410319" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.325012] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd1e994a-7040-438e-8603-1e32b8410319',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.333624] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84724a7c-0be4-4876-8b8a-1bb9a761ccbe [ 634.334889] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.334889] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.334889] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.334889] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.334889] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.335203] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84724a7c-0be4-4876-8b8a-1bb9a761ccbe already deleted. [ 634.335203] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84724a7c-0be4-4876-8b8a-1bb9a761ccbe" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.439053] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ea9c700-dac6-4282-90b7-8b85af493263 in Status: SUCCESS [ 634.439576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.827082] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd1e994a-7040-438e-8603-1e32b8410319 [ 634.827171] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.827279] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.827358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.827583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.828295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.828295] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd1e994a-7040-438e-8603-1e32b8410319 already deleted. [ 634.828295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd1e994a-7040-438e-8603-1e32b8410319" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.310589] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6612b52-6412-47ab-8918-14b6b8bca0cb in Status: SUCCESS [ 635.311307] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.311307] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.311456] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.312457] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.312457] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.312457] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.312457] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.312457] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.312457] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.312457] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6612b52-6412-47ab-8918-14b6b8bca0cb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.523172] env[66994]: INFO networking_nsxv3.common.synchronization [req-bd3d91c8-47ea-4a4e-931a-db78acda8f2a req-9ed14a41-5c55-49ae-b06a-9502f297e4ba tempest-ServersAdminNegativeTestJSON-2113491752 tempest-ServersAdminNegativeTestJSON-2113491752-project-member] Enqueued Resource ID: 91e3865c-9322-423a-9d64-5c548ef52da8 with Priority: HIGHEST for action security_group_members [ 635.523172] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91e3865c-9322-423a-9d64-5c548ef52da8 with Priority: HIGHEST for action security_group_members [ 635.524126] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-91e3865c-9322-423a-9d64-5c548ef52da8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.524557] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.524894] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.525200] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.525568] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.526029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.526624] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.526888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.527078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.527868] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91e3865c-9322-423a-9d64-5c548ef52da8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.819696] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6612b52-6412-47ab-8918-14b6b8bca0cb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.864022] env[66994]: INFO networking_nsxv3.common.synchronization [req-07e7772f-635b-4145-8ab7-1e8f697def60 req-416366d9-71fc-469f-a334-42297d234be4 tempest-SecurityGroupRulesTestJSON-2081492605 tempest-SecurityGroupRulesTestJSON-2081492605-project-member] Enqueued Resource ID: 6698e38d-ecdc-41a0-a1f4-932a882b534a with Priority: HIGHEST for action security_group_rules [ 635.867791] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6698e38d-ecdc-41a0-a1f4-932a882b534a with Priority: HIGHEST for action security_group_rules [ 635.867791] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6698e38d-ecdc-41a0-a1f4-932a882b534a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.867791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6698e38d-ecdc-41a0-a1f4-932a882b534a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.867791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6698e38d-ecdc-41a0-a1f4-932a882b534a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.867791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6698e38d-ecdc-41a0-a1f4-932a882b534a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.867791] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6698e38d-ecdc-41a0-a1f4-932a882b534a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.031650] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('91e3865c-9322-423a-9d64-5c548ef52da8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.268693] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.268877] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.269095] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.269598] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.270116] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.270454] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.270691] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.270960] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.271155] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.271390] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.271669] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 636.271838] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 636.271950] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 636.272718] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.272923] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 636.273089] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 636.297736] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 636.297961] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 636.298114] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 636.298360] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.298725] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-6fe7a00b-8d2c-403a-9b07-1f779b3e0d69 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.298908] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-6fe7a00b-8d2c-403a-9b07-1f779b3e0d69" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.299361] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-6fe7a00b-8d2c-403a-9b07-1f779b3e0d69" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.299464] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-6fe7a00b-8d2c-403a-9b07-1f779b3e0d69" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.299521] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fe7a00b-8d2c-403a-9b07-1f779b3e0d69',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.325386] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6612b52-6412-47ab-8918-14b6b8bca0cb: rpc.has_security_group_logging(os_id): False [ 636.329781] env[66994]: INFO networking_nsxv3.common.synchronization [None req-2f25743c-f623-4c2a-a4f2-b840640c1bd4 None None] Enqueued Resource ID: f51d6de6-9e56-4b7e-ba44-58a6101e0622 with Priority: HIGHEST for action port [ 636.330417] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f51d6de6-9e56-4b7e-ba44-58a6101e0622 with Priority: HIGHEST for action port [ 636.330801] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-f51d6de6-9e56-4b7e-ba44-58a6101e0622 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.330976] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f51d6de6-9e56-4b7e-ba44-58a6101e0622" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.331050] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f51d6de6-9e56-4b7e-ba44-58a6101e0622" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.331404] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f51d6de6-9e56-4b7e-ba44-58a6101e0622" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.331460] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f51d6de6-9e56-4b7e-ba44-58a6101e0622',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.352683] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.353131] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.353276] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.353565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.353711] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.354039] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.354194] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.354408] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.354756] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.354818] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.354958] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6612b52-6412-47ab-8918-14b6b8bca0cb is going to be created. [ 636.389591] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.389879] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.389879] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.390064] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.390064] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.390169] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6698e38d-ecdc-41a0-a1f4-932a882b534a already deleted. [ 636.390230] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6698e38d-ecdc-41a0-a1f4-932a882b534a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.450790] env[66994]: INFO networking_nsxv3.common.synchronization [None req-c576ae3c-7297-49e2-9729-2a348a59cb5e None None] Enqueued Resource ID: ceb225f6-7603-47ad-80e9-288930fe1f90 with Priority: HIGHEST for action port [ 636.451626] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceb225f6-7603-47ad-80e9-288930fe1f90 with Priority: HIGHEST for action port [ 636.452175] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-ceb225f6-7603-47ad-80e9-288930fe1f90 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.452394] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ceb225f6-7603-47ad-80e9-288930fe1f90" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.452559] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ceb225f6-7603-47ad-80e9-288930fe1f90" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.452856] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ceb225f6-7603-47ad-80e9-288930fe1f90" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.453044] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ceb225f6-7603-47ad-80e9-288930fe1f90',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.457382] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.457538] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.457624] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.458557] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.458557] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.473833] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6612b52-6412-47ab-8918-14b6b8bca0cb in Status: IN_PROGRESS for 2s [ 636.534250] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('91e3865c-9322-423a-9d64-5c548ef52da8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.802159] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.802421] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.802508] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.802806] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.802962] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.803144] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 6fe7a00b-8d2c-403a-9b07-1f779b3e0d69 not found, creating... [ 636.803418] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.803575] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.803683] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.803937] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.804086] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.804361] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.804509] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.804619] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.804827] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.804955] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.805137] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 6fe7a00b-8d2c-403a-9b07-1f779b3e0d69 is going to be created. [ 636.831576] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.831576] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.831576] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.831576] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.831576] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.831576] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-6fe7a00b-8d2c-403a-9b07-1f779b3e0d69" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.834602] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f51d6de6-9e56-4b7e-ba44-58a6101e0622 [ 636.835150] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.835150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.835150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.838990] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.839146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.839232] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f51d6de6-9e56-4b7e-ba44-58a6101e0622 already deleted. [ 636.839323] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f51d6de6-9e56-4b7e-ba44-58a6101e0622" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.957069] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ceb225f6-7603-47ad-80e9-288930fe1f90 [ 636.957069] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.958058] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.958058] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.958058] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.958058] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.958058] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ceb225f6-7603-47ad-80e9-288930fe1f90 already deleted. [ 636.958058] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ceb225f6-7603-47ad-80e9-288930fe1f90" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.037818] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.037818] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.037818] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.037818] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.038275] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.038275] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91e3865c-9322-423a-9d64-5c548ef52da8 is going to be updated. [ 637.071694] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.071918] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.071918] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.072147] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.072299] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.082335] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91e3865c-9322-423a-9d64-5c548ef52da8 in Status: IN_PROGRESS for 2s [ 637.597214] env[66994]: INFO networking_nsxv3.common.synchronization [req-bd3d91c8-47ea-4a4e-931a-db78acda8f2a req-61c8adec-5541-4107-8ff4-1b594b3ca2bf service nova] Enqueued Resource ID: 91e3865c-9322-423a-9d64-5c548ef52da8 with Priority: HIGHEST for action security_group_rules [ 637.597214] env[66994]: INFO networking_nsxv3.common.synchronization [req-bd3d91c8-47ea-4a4e-931a-db78acda8f2a req-61c8adec-5541-4107-8ff4-1b594b3ca2bf service nova] Enqueued Resource ID: 91e3865c-9322-423a-9d64-5c548ef52da8 with Priority: HIGHEST for action security_group_members [ 637.597214] env[66994]: INFO networking_nsxv3.common.synchronization [req-bd3d91c8-47ea-4a4e-931a-db78acda8f2a req-61c8adec-5541-4107-8ff4-1b594b3ca2bf service nova] Enqueued Resource ID: 6fe7a00b-8d2c-403a-9b07-1f779b3e0d69 with Priority: HIGHEST for action port [ 637.597214] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91e3865c-9322-423a-9d64-5c548ef52da8 with Priority: HIGHEST for action security_group_rules [ 637.597214] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91e3865c-9322-423a-9d64-5c548ef52da8 with Priority: HIGHEST for action security_group_members [ 637.597214] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe7a00b-8d2c-403a-9b07-1f779b3e0d69 with Priority: HIGHEST for action port [ 637.598158] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91e3865c-9322-423a-9d64-5c548ef52da8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.598433] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.598585] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.598873] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.599059] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91e3865c-9322-423a-9d64-5c548ef52da8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.601865] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-91e3865c-9322-423a-9d64-5c548ef52da8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.602160] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.604367] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fe7a00b-8d2c-403a-9b07-1f779b3e0d69 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.604367] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fe7a00b-8d2c-403a-9b07-1f779b3e0d69" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.604367] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fe7a00b-8d2c-403a-9b07-1f779b3e0d69" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.604367] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fe7a00b-8d2c-403a-9b07-1f779b3e0d69" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.604367] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fe7a00b-8d2c-403a-9b07-1f779b3e0d69',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.105709] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-91e3865c-9322-423a-9d64-5c548ef52da8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.105936] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.106280] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fe7a00b-8d2c-403a-9b07-1f779b3e0d69 with status ACTIVE [ 638.106590] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.107315] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.107315] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.107315] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.107315] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.107731] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.107785] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.107860] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.109030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.109152] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.109450] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.109450] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.109544] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.109684] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.109765] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.109856] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fe7a00b-8d2c-403a-9b07-1f779b3e0d69 is going to be updated. [ 638.132981] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.132981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.132981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.132981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.132981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.133799] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fe7a00b-8d2c-403a-9b07-1f779b3e0d69" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.489921] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6612b52-6412-47ab-8918-14b6b8bca0cb in Status: SUCCESS [ 638.489921] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.094042] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91e3865c-9322-423a-9d64-5c548ef52da8 in Status: SUCCESS [ 639.094426] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.094616] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.094740] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.094956] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.095088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.095149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.095375] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.095448] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.095500] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91e3865c-9322-423a-9d64-5c548ef52da8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.155149] env[66994]: INFO networking_nsxv3.common.synchronization [req-7a2e67a5-c15b-4589-8aa4-48ff74809a9a req-e61049e0-9d09-450f-8bfe-d82924eccaad tempest-InstanceActionsV221TestJSON-1907997106 tempest-InstanceActionsV221TestJSON-1907997106-project-member] Enqueued Resource ID: f2f71bab-7256-4f84-bd3c-ad2bf1145250 with Priority: HIGHEST for action security_group_members [ 639.155586] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2f71bab-7256-4f84-bd3c-ad2bf1145250 with Priority: HIGHEST for action security_group_members [ 639.157122] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2f71bab-7256-4f84-bd3c-ad2bf1145250 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.157262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.157359] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.157657] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.157908] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.158071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.158265] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.158694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.158694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.158694] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2f71bab-7256-4f84-bd3c-ad2bf1145250',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.563071] env[66994]: INFO networking_nsxv3.common.synchronization [None req-9a9aa7c4-4b23-4b95-9f34-d83de6f5a2c9 None None] Enqueued Resource ID: a24e684c-1766-4b28-9061-dce0c0f3d93f with Priority: HIGHEST for action port [ 639.563644] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a24e684c-1766-4b28-9061-dce0c0f3d93f with Priority: HIGHEST for action port [ 639.563940] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-a24e684c-1766-4b28-9061-dce0c0f3d93f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.564280] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a24e684c-1766-4b28-9061-dce0c0f3d93f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.564280] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a24e684c-1766-4b28-9061-dce0c0f3d93f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.564393] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a24e684c-1766-4b28-9061-dce0c0f3d93f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.564458] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a24e684c-1766-4b28-9061-dce0c0f3d93f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.597663] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('91e3865c-9322-423a-9d64-5c548ef52da8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.616940] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.617180] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-861" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.617331] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-861" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.617624] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-861" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.617905] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.618158] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.618386] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.618577] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.618741] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.618983] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.619120] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.619252] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.619376] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.619559] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.619713] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.619867] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.641719] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.641878] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 639.642665] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.642665] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-861" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.642665] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-ec5e5604-7fdc-480f-bd89-f2d5dabe9ff8 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.642935] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-ec5e5604-7fdc-480f-bd89-f2d5dabe9ff8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.643105] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-ec5e5604-7fdc-480f-bd89-f2d5dabe9ff8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.643447] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-ec5e5604-7fdc-480f-bd89-f2d5dabe9ff8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.643617] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec5e5604-7fdc-480f-bd89-f2d5dabe9ff8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.661394] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.661788] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.662043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.662453] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.662551] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.662768] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.662942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.663014] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.663237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.663429] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.663524] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2f71bab-7256-4f84-bd3c-ad2bf1145250 already deleted. [ 639.663607] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.667755] env[66994]: INFO networking_nsxv3.common.synchronization [None req-51b10b65-4596-4d13-9726-a36256b54c89 None None] Enqueued Resource ID: 4670ada0-3a20-4ab9-8dff-c8d24e60583d with Priority: HIGHEST for action port [ 639.668013] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4670ada0-3a20-4ab9-8dff-c8d24e60583d with Priority: HIGHEST for action port [ 639.668947] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-4670ada0-3a20-4ab9-8dff-c8d24e60583d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.669076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4670ada0-3a20-4ab9-8dff-c8d24e60583d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.669144] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4670ada0-3a20-4ab9-8dff-c8d24e60583d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.669359] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4670ada0-3a20-4ab9-8dff-c8d24e60583d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.669440] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4670ada0-3a20-4ab9-8dff-c8d24e60583d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.067878] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a24e684c-1766-4b28-9061-dce0c0f3d93f [ 640.068142] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.068283] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.068353] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.068597] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.068676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.068786] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a24e684c-1766-4b28-9061-dce0c0f3d93f already deleted. [ 640.068869] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a24e684c-1766-4b28-9061-dce0c0f3d93f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.102423] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('91e3865c-9322-423a-9d64-5c548ef52da8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.147232] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.147936] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.147936] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.148343] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.149137] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.149137] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port ec5e5604-7fdc-480f-bd89-f2d5dabe9ff8 not found, creating... [ 640.149671] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.150018] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.150235] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.150618] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.151056] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.151433] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.151723] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.151816] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.154196] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.154196] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.154196] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: ec5e5604-7fdc-480f-bd89-f2d5dabe9ff8 is going to be created. [ 640.172143] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4670ada0-3a20-4ab9-8dff-c8d24e60583d [ 640.172143] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.172555] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.172555] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.172633] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.173237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.173237] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4670ada0-3a20-4ab9-8dff-c8d24e60583d already deleted. [ 640.173237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4670ada0-3a20-4ab9-8dff-c8d24e60583d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.180631] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.180913] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.180963] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.182038] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.182038] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.182038] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-ec5e5604-7fdc-480f-bd89-f2d5dabe9ff8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.604925] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.605131] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.605223] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.605453] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.605548] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.605649] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91e3865c-9322-423a-9d64-5c548ef52da8 is going to be updated. [ 640.641328] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.641514] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.641598] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.641800] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.641944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.653601] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91e3865c-9322-423a-9d64-5c548ef52da8 in Status: IN_PROGRESS for 2s [ 641.035169] env[66994]: INFO networking_nsxv3.common.synchronization [req-7a2e67a5-c15b-4589-8aa4-48ff74809a9a req-6b5a0649-7ae2-4e05-9957-79f1ce79e7c7 service nova] Enqueued Resource ID: f2f71bab-7256-4f84-bd3c-ad2bf1145250 with Priority: HIGHEST for action security_group_rules [ 641.035380] env[66994]: INFO networking_nsxv3.common.synchronization [req-7a2e67a5-c15b-4589-8aa4-48ff74809a9a req-6b5a0649-7ae2-4e05-9957-79f1ce79e7c7 service nova] Enqueued Resource ID: f2f71bab-7256-4f84-bd3c-ad2bf1145250 with Priority: HIGHEST for action security_group_members [ 641.035904] env[66994]: INFO networking_nsxv3.common.synchronization [req-7a2e67a5-c15b-4589-8aa4-48ff74809a9a req-6b5a0649-7ae2-4e05-9957-79f1ce79e7c7 service nova] Enqueued Resource ID: ec5e5604-7fdc-480f-bd89-f2d5dabe9ff8 with Priority: HIGHEST for action port [ 641.036885] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2f71bab-7256-4f84-bd3c-ad2bf1145250 with Priority: HIGHEST for action security_group_rules [ 641.036885] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2f71bab-7256-4f84-bd3c-ad2bf1145250 with Priority: HIGHEST for action security_group_members [ 641.036885] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec5e5604-7fdc-480f-bd89-f2d5dabe9ff8 with Priority: HIGHEST for action port [ 641.038012] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2f71bab-7256-4f84-bd3c-ad2bf1145250 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.038012] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.038012] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.038012] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.038012] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2f71bab-7256-4f84-bd3c-ad2bf1145250',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.039060] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2f71bab-7256-4f84-bd3c-ad2bf1145250 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.039265] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.039265] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.039403] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.040822] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.040972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.041160] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.041291] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.041577] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.041577] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2f71bab-7256-4f84-bd3c-ad2bf1145250',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.044796] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec5e5604-7fdc-480f-bd89-f2d5dabe9ff8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.044796] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec5e5604-7fdc-480f-bd89-f2d5dabe9ff8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.044796] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec5e5604-7fdc-480f-bd89-f2d5dabe9ff8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.044796] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec5e5604-7fdc-480f-bd89-f2d5dabe9ff8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.044796] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec5e5604-7fdc-480f-bd89-f2d5dabe9ff8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.142916] env[66994]: INFO networking_nsxv3.common.synchronization [None req-1a6ad205-e6f6-4429-8956-59aa57979e53 tempest-ServerActionsV293TestJSON-570448108 tempest-ServerActionsV293TestJSON-570448108-project-member] Enqueued Resource ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b with Priority: HIGHEST for action security_group_rules [ 641.144610] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b with Priority: HIGHEST for action security_group_rules [ 641.145056] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.145225] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.145512] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.145758] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.145892] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4672e8d-a5ca-46f8-8d7b-adf4da6e472b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.485385] env[66994]: INFO networking_nsxv3.common.synchronization [None req-0bc06ef2-1ca3-417b-8379-f6d0360e6962 tempest-ServerActionsV293TestJSON-570448108 tempest-ServerActionsV293TestJSON-570448108-project-member] Enqueued Resource ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b with Priority: HIGHEST for action security_group_rules [ 641.485947] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b with Priority: HIGHEST for action security_group_rules [ 641.486354] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.486452] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.539905] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2f71bab-7256-4f84-bd3c-ad2bf1145250 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.540066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.548300] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec5e5604-7fdc-480f-bd89-f2d5dabe9ff8 with status ACTIVE [ 641.548300] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.548300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.548300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.548300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.548300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.548541] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.549099] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.549203] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.549420] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.549515] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.549804] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.549931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.549998] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.551025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.551025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.551025] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec5e5604-7fdc-480f-bd89-f2d5dabe9ff8 is going to be updated. [ 641.551565] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f2f71bab-7256-4f84-bd3c-ad2bf1145250',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.576680] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.576839] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.577779] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.578043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.578309] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.578484] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec5e5604-7fdc-480f-bd89-f2d5dabe9ff8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.670307] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.670462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.670534] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.670987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.671139] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.671260] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b already deleted. [ 641.671354] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.671525] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.671731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.671816] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4672e8d-a5ca-46f8-8d7b-adf4da6e472b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.020377] env[66994]: INFO networking_nsxv3.common.synchronization [req-c5454e2c-9eb6-4060-bf32-e100dbe25d4b req-a0a375e4-d135-426c-80d8-1d8b564b820f tempest-ListServerFiltersTestJSON-483871491 tempest-ListServerFiltersTestJSON-483871491-project-member] Enqueued Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_members [ 642.020687] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_members [ 642.021480] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.021691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.022647] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.023050] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.023364] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.023554] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.023710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.023974] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.024145] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.024350] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.055413] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f2f71bab-7256-4f84-bd3c-ad2bf1145250',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.198064] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.199318] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.199318] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.199318] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.199318] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.201645] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b already deleted. [ 642.201645] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.231564] env[66994]: INFO networking_nsxv3.common.synchronization [None req-f5cc0f7e-0782-4f4c-b15a-de87ed5453b4 None None] Enqueued Resource ID: ab303b2c-b9fa-49a4-9af9-5bc85c336c47 with Priority: HIGHEST for action port [ 642.231564] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab303b2c-b9fa-49a4-9af9-5bc85c336c47 with Priority: HIGHEST for action port [ 642.231564] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab303b2c-b9fa-49a4-9af9-5bc85c336c47 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.231564] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab303b2c-b9fa-49a4-9af9-5bc85c336c47" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.231564] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab303b2c-b9fa-49a4-9af9-5bc85c336c47" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.231979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab303b2c-b9fa-49a4-9af9-5bc85c336c47" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.232121] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab303b2c-b9fa-49a4-9af9-5bc85c336c47',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.527435] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.527655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.527756] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.528041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.528231] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.528410] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.528552] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.528643] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.528892] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.528965] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.529070] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb already deleted. [ 642.529178] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.561559] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.561665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.561710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.561916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.562039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.562147] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2f71bab-7256-4f84-bd3c-ad2bf1145250 is going to be created. [ 642.582153] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.582381] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-608" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.582519] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-608" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.582835] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-608" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.583164] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.583322] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.584212] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.584212] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.584212] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.584212] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.588148] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 642.588148] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 642.588148] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 642.588148] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.588148] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 642.588148] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 642.598835] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.599079] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.599079] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.599272] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.599428] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.610768] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2f71bab-7256-4f84-bd3c-ad2bf1145250 in Status: UNINITIALIZED for 2s [ 642.615404] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 642.615558] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 642.615696] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 642.615860] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-608" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.616195] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-95551570-ce8d-4bf4-bd44-84df42886e2a taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.616362] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-95551570-ce8d-4bf4-bd44-84df42886e2a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.616484] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-95551570-ce8d-4bf4-bd44-84df42886e2a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.616850] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-95551570-ce8d-4bf4-bd44-84df42886e2a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.617628] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95551570-ce8d-4bf4-bd44-84df42886e2a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.670458] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91e3865c-9322-423a-9d64-5c548ef52da8 in Status: SUCCESS [ 642.670803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.670923] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.671734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.671734] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.671734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.671734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.671734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.672423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.672423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.672423] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('91e3865c-9322-423a-9d64-5c548ef52da8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.736722] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab303b2c-b9fa-49a4-9af9-5bc85c336c47 [ 642.736722] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.736898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.737035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.737218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.737410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.737410] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab303b2c-b9fa-49a4-9af9-5bc85c336c47 already deleted. [ 642.737518] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab303b2c-b9fa-49a4-9af9-5bc85c336c47" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.125023] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.125023] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.125023] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.125023] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.125023] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.125023] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 95551570-ce8d-4bf4-bd44-84df42886e2a not found, creating... [ 643.125023] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.125023] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.125023] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.125023] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.125023] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.125646] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.125646] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.125646] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.125646] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.126181] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.126630] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 95551570-ce8d-4bf4-bd44-84df42886e2a is going to be created. [ 643.150702] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.152989] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.152989] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.152989] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.152989] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.152989] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-95551570-ce8d-4bf4-bd44-84df42886e2a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.174231] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-91e3865c-9322-423a-9d64-5c548ef52da8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.174436] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.174497] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.174709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.174871] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.174980] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.175051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.175201] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.175321] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.175366] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.175511] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-91e3865c-9322-423a-9d64-5c548ef52da8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.175618] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.175673] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.175794] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.175966] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.176145] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.176145] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.176228] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.176323] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.176375] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.176469] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('91e3865c-9322-423a-9d64-5c548ef52da8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.647845] env[66994]: INFO networking_nsxv3.common.synchronization [req-da81706d-af25-47fa-b252-c9c2efc7fb40 req-991e7450-e6c4-4428-9879-30f3ca426ec8 tempest-ImagesNegativeTestJSON-763648599 tempest-ImagesNegativeTestJSON-763648599-project-member] Enqueued Resource ID: c80fb398-76b1-47f9-8bb6-a122061a01d6 with Priority: HIGHEST for action security_group_members [ 643.648487] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c80fb398-76b1-47f9-8bb6-a122061a01d6 with Priority: HIGHEST for action security_group_members [ 643.648774] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-c80fb398-76b1-47f9-8bb6-a122061a01d6 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.648887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.648956] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.649360] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.649360] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.649554] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.649554] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.649683] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.649729] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.649830] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c80fb398-76b1-47f9-8bb6-a122061a01d6',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.679942] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 91e3865c-9322-423a-9d64-5c548ef52da8: rpc.has_security_group_logging(os_id): False [ 643.701155] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.701155] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.701369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.701429] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.701547] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.701810] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.701963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.702045] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.702251] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.702359] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.702642] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.703236] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.703236] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.703236] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.703441] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.703746] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.703906] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.704022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.704182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.705039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.705039] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91e3865c-9322-423a-9d64-5c548ef52da8 is going to be updated. [ 643.772434] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.772593] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.772651] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.772896] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.773037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.786917] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 91e3865c-9322-423a-9d64-5c548ef52da8 in Status: IN_PROGRESS for 2s [ 643.892326] env[66994]: INFO networking_nsxv3.common.synchronization [req-c5454e2c-9eb6-4060-bf32-e100dbe25d4b req-e7f35000-2d24-4892-9377-aeab0c75f8fc service nova] Enqueued Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_rules [ 643.892326] env[66994]: INFO networking_nsxv3.common.synchronization [req-c5454e2c-9eb6-4060-bf32-e100dbe25d4b req-e7f35000-2d24-4892-9377-aeab0c75f8fc service nova] Enqueued Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_members [ 643.892626] env[66994]: INFO networking_nsxv3.common.synchronization [req-c5454e2c-9eb6-4060-bf32-e100dbe25d4b req-e7f35000-2d24-4892-9377-aeab0c75f8fc service nova] Enqueued Resource ID: 95551570-ce8d-4bf4-bd44-84df42886e2a with Priority: HIGHEST for action port [ 643.892990] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_rules [ 643.893713] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_members [ 643.893934] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95551570-ce8d-4bf4-bd44-84df42886e2a with Priority: HIGHEST for action port [ 643.894927] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.894998] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.895367] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.895574] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.895684] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.898327] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.898327] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.898327] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.901104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.901399] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.901572] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.902008] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.902008] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.902260] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.905466] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.906233] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-95551570-ce8d-4bf4-bd44-84df42886e2a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.907170] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95551570-ce8d-4bf4-bd44-84df42886e2a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.907170] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95551570-ce8d-4bf4-bd44-84df42886e2a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.907170] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95551570-ce8d-4bf4-bd44-84df42886e2a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.907170] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95551570-ce8d-4bf4-bd44-84df42886e2a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.154752] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.154944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.154988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.155345] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.157035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.157035] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.157035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.157035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.157035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.157035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.157035] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c80fb398-76b1-47f9-8bb6-a122061a01d6 is going to be updated. [ 644.184817] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.185019] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.185067] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.185282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.185427] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.195330] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c80fb398-76b1-47f9-8bb6-a122061a01d6 in Status: IN_PROGRESS for 2s [ 644.414423] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.414595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.414799] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.416396] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 95551570-ce8d-4bf4-bd44-84df42886e2a with status ACTIVE [ 644.416587] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.416727] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.416783] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.417036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.417137] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.417318] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.417440] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.417490] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.417663] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.417740] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.418222] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.418222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.418222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.418584] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.418584] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.418584] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 95551570-ce8d-4bf4-bd44-84df42886e2a is going to be updated. [ 644.442367] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.442571] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.442672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.442929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.443105] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.443261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95551570-ce8d-4bf4-bd44-84df42886e2a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.625795] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2f71bab-7256-4f84-bd3c-ad2bf1145250 in Status: SUCCESS [ 644.626136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.626657] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.626991] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.627283] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.627472] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.627583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.627815] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.627904] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.627994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.628122] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f2f71bab-7256-4f84-bd3c-ad2bf1145250',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.917597] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.134814] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2f71bab-7256-4f84-bd3c-ad2bf1145250 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.135244] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.135326] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.135574] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.135782] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.135894] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.136027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.136200] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.136307] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.136405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.136559] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2f71bab-7256-4f84-bd3c-ad2bf1145250 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.136656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.136727] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.136875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.137037] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.137130] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.137189] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.137337] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.137410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.137492] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.137590] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f2f71bab-7256-4f84-bd3c-ad2bf1145250',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.420992] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.421097] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.421134] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.421349] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.421445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.421559] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb is going to be created. [ 645.436815] env[66994]: INFO networking_nsxv3.common.synchronization [req-d83a0eae-e1e8-4086-9d4d-45dbc3d0e751 req-64107e19-8fa3-4e97-ae51-b3514e689fe8 tempest-SecurityGroupRulesTestJSON-2081492605 tempest-SecurityGroupRulesTestJSON-2081492605-project-member] Enqueued Resource ID: c85f5264-2427-40a4-a36d-35ccb8764951 with Priority: HIGHEST for action security_group_rules [ 645.437969] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c85f5264-2427-40a4-a36d-35ccb8764951 with Priority: HIGHEST for action security_group_rules [ 645.438407] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c85f5264-2427-40a4-a36d-35ccb8764951 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.438536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c85f5264-2427-40a4-a36d-35ccb8764951" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.438651] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c85f5264-2427-40a4-a36d-35ccb8764951" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.438853] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c85f5264-2427-40a4-a36d-35ccb8764951" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.438936] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c85f5264-2427-40a4-a36d-35ccb8764951',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.447948] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.448855] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.448855] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.449113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.449151] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.463378] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: UNINITIALIZED for 2s [ 645.642301] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f2f71bab-7256-4f84-bd3c-ad2bf1145250: rpc.has_security_group_logging(os_id): False [ 645.662292] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.662470] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.662518] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.663144] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.663144] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.663144] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.663339] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.663339] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.663405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.663493] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.663644] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.663737] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.663845] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.663934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.664018] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.664276] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.664376] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.664431] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.664569] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.664688] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.664736] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2f71bab-7256-4f84-bd3c-ad2bf1145250 is going to be created. [ 645.727349] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.727544] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.727642] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.727876] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.728129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.742479] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2f71bab-7256-4f84-bd3c-ad2bf1145250 in Status: IN_PROGRESS for 2s [ 645.802049] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 91e3865c-9322-423a-9d64-5c548ef52da8 in Status: SUCCESS [ 645.802049] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.964107] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.964856] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.965573] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.966098] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.966098] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.966313] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c85f5264-2427-40a4-a36d-35ccb8764951 already deleted. [ 645.966313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c85f5264-2427-40a4-a36d-35ccb8764951" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.211411] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c80fb398-76b1-47f9-8bb6-a122061a01d6 in Status: SUCCESS [ 646.211577] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c80fb398-76b1-47f9-8bb6-a122061a01d6 deletion is rescheduled due to dependency. [ 646.211742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.499194] env[66994]: INFO networking_nsxv3.common.synchronization [req-bcfc090e-dcc1-4456-b85d-12b4c5ee30a4 req-8daeeaad-32ad-4fdd-9f07-86e955f8fa49 tempest-FloatingIPsAssociationTestJSON-1494503625 tempest-FloatingIPsAssociationTestJSON-1494503625-project-member] Enqueued Resource ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea with Priority: HIGHEST for action security_group_members [ 646.499810] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea with Priority: HIGHEST for action security_group_members [ 646.503434] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.503434] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.503434] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.503703] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.503952] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.504090] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.504167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.504305] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.504388] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.505249] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605734aa-d0fb-486b-9d2a-22c70d9dd0ea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.007137] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605734aa-d0fb-486b-9d2a-22c70d9dd0ea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.016389] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-74 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.016389] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.016389] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.016389] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.016389] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.016389] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.016389] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.016389] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.016389] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.017225] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.017418] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.017533] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.017641] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.017752] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.017851] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.017978] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.043022] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 647.043022] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 647.043022] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 647.043022] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.043022] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-b819e013-8716-47b1-99d0-6f8af4257f91 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.043022] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-b819e013-8716-47b1-99d0-6f8af4257f91" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.043022] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-b819e013-8716-47b1-99d0-6f8af4257f91" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.043022] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-b819e013-8716-47b1-99d0-6f8af4257f91" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.044590] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b819e013-8716-47b1-99d0-6f8af4257f91',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.474367] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: SUCCESS [ 647.474629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.474859] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.475140] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.475377] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.475533] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.475607] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.475778] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.475886] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.475942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.476041] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.509625] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605734aa-d0fb-486b-9d2a-22c70d9dd0ea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.545982] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.546321] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.546420] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.546763] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.546932] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.547098] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port b819e013-8716-47b1-99d0-6f8af4257f91 not found, creating... [ 647.547369] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.547611] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.547801] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.547858] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.547977] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.548270] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.548422] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.548615] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.548735] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.548861] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.549057] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: b819e013-8716-47b1-99d0-6f8af4257f91 is going to be created. [ 647.573362] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.573625] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.573777] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.574107] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.574376] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.574624] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-b819e013-8716-47b1-99d0-6f8af4257f91" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.765392] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2f71bab-7256-4f84-bd3c-ad2bf1145250 in Status: SUCCESS [ 647.765392] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.978187] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.979197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.979197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.979197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.979197] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.979197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.979197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.979559] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.979666] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.979764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.979964] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.980132] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.980220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.980406] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.980581] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.980711] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.980845] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.980995] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.981122] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.981234] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.981349] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.015675] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.015988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.015988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.016164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.016258] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.016357] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea is going to be updated. [ 648.051022] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.051189] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.051260] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.051488] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.051640] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.065375] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea in Status: IN_PROGRESS for 2s [ 648.346536] env[66994]: INFO networking_nsxv3.common.synchronization [req-bcfc090e-dcc1-4456-b85d-12b4c5ee30a4 req-e5c1c971-2b71-4d7a-b190-96ae50e52cb1 service nova] Enqueued Resource ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea with Priority: HIGHEST for action security_group_rules [ 648.346726] env[66994]: INFO networking_nsxv3.common.synchronization [req-bcfc090e-dcc1-4456-b85d-12b4c5ee30a4 req-e5c1c971-2b71-4d7a-b190-96ae50e52cb1 service nova] Enqueued Resource ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea with Priority: HIGHEST for action security_group_members [ 648.346852] env[66994]: INFO networking_nsxv3.common.synchronization [req-bcfc090e-dcc1-4456-b85d-12b4c5ee30a4 req-e5c1c971-2b71-4d7a-b190-96ae50e52cb1 service nova] Enqueued Resource ID: b819e013-8716-47b1-99d0-6f8af4257f91 with Priority: HIGHEST for action port [ 648.347565] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea with Priority: HIGHEST for action security_group_rules [ 648.347644] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea with Priority: HIGHEST for action security_group_members [ 648.347743] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b819e013-8716-47b1-99d0-6f8af4257f91 with Priority: HIGHEST for action port [ 648.348033] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605734aa-d0fb-486b-9d2a-22c70d9dd0ea taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.348171] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.348238] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.348454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.348535] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605734aa-d0fb-486b-9d2a-22c70d9dd0ea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.349612] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.350599] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.350599] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-b819e013-8716-47b1-99d0-6f8af4257f91 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.350599] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b819e013-8716-47b1-99d0-6f8af4257f91" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.350599] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b819e013-8716-47b1-99d0-6f8af4257f91" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.350599] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b819e013-8716-47b1-99d0-6f8af4257f91" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.350599] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b819e013-8716-47b1-99d0-6f8af4257f91',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.483854] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ca0171b-7165-4d45-aa70-8fe66df074eb: rpc.has_security_group_logging(os_id): False [ 648.504752] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.504907] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.504907] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.505535] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.505535] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.505535] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.505734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.505734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.505806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.505861] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.506108] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.506213] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.506273] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.506414] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.506484] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.506658] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.506745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.506799] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.506931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.510020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.510527] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb is going to be created. [ 648.585128] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.585622] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.588678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.588678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.588678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.599157] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: IN_PROGRESS for 2s [ 648.854111] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.854111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.854111] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b819e013-8716-47b1-99d0-6f8af4257f91 with status ACTIVE [ 648.854111] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.854111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.854111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.854111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.854111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.854111] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.854111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.854111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.854691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.854691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.854779] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.854829] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.854861] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.855031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.855107] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.855147] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b819e013-8716-47b1-99d0-6f8af4257f91 is going to be updated. [ 648.882786] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.882786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.882786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.883492] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.883812] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.884326] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b819e013-8716-47b1-99d0-6f8af4257f91" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.905098] env[66994]: INFO networking_nsxv3.common.synchronization [req-246a0e99-a611-41b0-8707-247630c6eae4 req-36f9268b-4097-4fd4-a9a9-572f5fb30de5 tempest-DeleteServersAdminTestJSON-1715216695 tempest-DeleteServersAdminTestJSON-1715216695-project-member] Enqueued Resource ID: 272acbad-bd3f-40f8-972f-dda18f503b74 with Priority: HIGHEST for action security_group_members [ 648.907227] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 272acbad-bd3f-40f8-972f-dda18f503b74 with Priority: HIGHEST for action security_group_members [ 648.907729] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-272acbad-bd3f-40f8-972f-dda18f503b74 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.907927] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.908932] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.908932] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.908932] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.908932] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.909202] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.910333] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.910488] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.910694] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('272acbad-bd3f-40f8-972f-dda18f503b74',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.358864] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.358864] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.358864] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.358864] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.358864] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.358864] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.358864] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.358864] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.358864] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.359530] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.359530] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.359530] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.359530] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.359530] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.359530] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.359750] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.383710] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.383710] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 649.383710] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.383710] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.383710] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-bd679dbe-8112-4726-a367-1904d733f78f taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.383710] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-bd679dbe-8112-4726-a367-1904d733f78f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.383710] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-bd679dbe-8112-4726-a367-1904d733f78f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.385591] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-bd679dbe-8112-4726-a367-1904d733f78f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.385788] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd679dbe-8112-4726-a367-1904d733f78f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.413629] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.413786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.413786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.414131] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.414221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.417790] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.417790] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.417790] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.417790] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.417790] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.417790] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 272acbad-bd3f-40f8-972f-dda18f503b74 is going to be updated. [ 649.445100] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.445411] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.445411] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.445692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.446016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.466311] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 272acbad-bd3f-40f8-972f-dda18f503b74 in Status: IN_PROGRESS for 2s [ 649.888768] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.888997] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.889139] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.889421] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.889561] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.889712] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port bd679dbe-8112-4726-a367-1904d733f78f not found, creating... [ 649.889972] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.890146] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.890257] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.890462] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.890590] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.890863] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.891045] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.891164] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.891362] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.891484] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.891616] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: bd679dbe-8112-4726-a367-1904d733f78f is going to be created. [ 649.916647] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.916848] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.916964] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.917233] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.917449] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.917652] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-bd679dbe-8112-4726-a367-1904d733f78f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.077337] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea in Status: SUCCESS [ 650.077604] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.077783] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.078036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.078236] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.078368] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.078434] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.078588] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.078670] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.078763] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605734aa-d0fb-486b-9d2a-22c70d9dd0ea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.581295] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605734aa-d0fb-486b-9d2a-22c70d9dd0ea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.615425] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: SUCCESS [ 650.615763] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.675524] env[66994]: INFO networking_nsxv3.common.synchronization [req-246a0e99-a611-41b0-8707-247630c6eae4 req-076f9b64-399c-4302-a6c4-b8042faacedb service nova] Enqueued Resource ID: 272acbad-bd3f-40f8-972f-dda18f503b74 with Priority: HIGHEST for action security_group_rules [ 650.675723] env[66994]: INFO networking_nsxv3.common.synchronization [req-246a0e99-a611-41b0-8707-247630c6eae4 req-076f9b64-399c-4302-a6c4-b8042faacedb service nova] Enqueued Resource ID: 272acbad-bd3f-40f8-972f-dda18f503b74 with Priority: HIGHEST for action security_group_members [ 650.675865] env[66994]: INFO networking_nsxv3.common.synchronization [req-246a0e99-a611-41b0-8707-247630c6eae4 req-076f9b64-399c-4302-a6c4-b8042faacedb service nova] Enqueued Resource ID: bd679dbe-8112-4726-a367-1904d733f78f with Priority: HIGHEST for action port [ 650.676463] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 272acbad-bd3f-40f8-972f-dda18f503b74 with Priority: HIGHEST for action security_group_rules [ 650.676629] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 272acbad-bd3f-40f8-972f-dda18f503b74 with Priority: HIGHEST for action security_group_members [ 650.676727] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd679dbe-8112-4726-a367-1904d733f78f with Priority: HIGHEST for action port [ 650.677026] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-272acbad-bd3f-40f8-972f-dda18f503b74 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.677854] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.677854] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.677854] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.678071] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('272acbad-bd3f-40f8-972f-dda18f503b74',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.679146] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-272acbad-bd3f-40f8-972f-dda18f503b74 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.679288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.679462] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd679dbe-8112-4726-a367-1904d733f78f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.679828] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd679dbe-8112-4726-a367-1904d733f78f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.679915] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd679dbe-8112-4726-a367-1904d733f78f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.680126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd679dbe-8112-4726-a367-1904d733f78f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.680211] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd679dbe-8112-4726-a367-1904d733f78f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.084918] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605734aa-d0fb-486b-9d2a-22c70d9dd0ea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.182126] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-272acbad-bd3f-40f8-972f-dda18f503b74 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.182421] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.182761] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd679dbe-8112-4726-a367-1904d733f78f with status ACTIVE [ 651.182990] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.183465] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.183465] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.183465] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.183634] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.183685] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.183792] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.183842] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.184031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.184105] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.184302] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.184404] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.184456] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.184622] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.184704] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.184789] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd679dbe-8112-4726-a367-1904d733f78f is going to be updated. [ 651.208639] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.208791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.208899] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.209142] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.209289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.209687] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd679dbe-8112-4726-a367-1904d733f78f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.480217] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 272acbad-bd3f-40f8-972f-dda18f503b74 in Status: SUCCESS [ 651.480217] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 272acbad-bd3f-40f8-972f-dda18f503b74 deletion is rescheduled due to dependency. [ 651.480217] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.480217] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.480217] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.480217] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.480217] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.480217] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.480217] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.480217] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.480217] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('272acbad-bd3f-40f8-972f-dda18f503b74',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.586849] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.587343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.587431] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.587582] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.587697] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.587944] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea is going to be updated. [ 651.621227] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.621343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.621390] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.622279] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.622279] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.637483] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea in Status: IN_PROGRESS for 2s [ 651.834761] env[66994]: INFO networking_nsxv3.common.synchronization [req-74e5bd95-b336-4ff8-ab93-2a419396bfbb req-dde0b4d8-2d86-44e4-9daf-124b4b43ca72 tempest-ServersTestBootFromVolume-2076386020 tempest-ServersTestBootFromVolume-2076386020-project-member] Enqueued Resource ID: 7176e416-370c-4ff8-be5b-5551a672ed01 with Priority: HIGHEST for action security_group_members [ 651.835374] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7176e416-370c-4ff8-be5b-5551a672ed01 with Priority: HIGHEST for action security_group_members [ 651.835672] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-7176e416-370c-4ff8-be5b-5551a672ed01 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.835843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.835888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.837229] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.837229] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.837229] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.837229] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.837229] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.837229] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.837229] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7176e416-370c-4ff8-be5b-5551a672ed01',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.981791] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('272acbad-bd3f-40f8-972f-dda18f503b74',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.048847] env[66994]: INFO networking_nsxv3.common.synchronization [req-70b7f9fa-b373-4d85-afc3-2e32a7e84c2a req-bf582ee6-8266-4b24-8f44-bc7ede7ded5d tempest-SecurityGroupRulesTestJSON-2081492605 tempest-SecurityGroupRulesTestJSON-2081492605-project-member] Enqueued Resource ID: 7c1d9931-fffd-4897-bf78-f61dac3e6bf3 with Priority: HIGHEST for action security_group_rules [ 652.048847] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c1d9931-fffd-4897-bf78-f61dac3e6bf3 with Priority: HIGHEST for action security_group_rules [ 652.049109] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c1d9931-fffd-4897-bf78-f61dac3e6bf3 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.049109] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c1d9931-fffd-4897-bf78-f61dac3e6bf3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.049220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c1d9931-fffd-4897-bf78-f61dac3e6bf3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.049727] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c1d9931-fffd-4897-bf78-f61dac3e6bf3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.049727] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c1d9931-fffd-4897-bf78-f61dac3e6bf3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.338951] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-605 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.338951] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-605" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.338951] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-605" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.341085] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-605" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.341085] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.341085] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.341085] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.341085] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.341085] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.341085] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.341085] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 652.341085] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 652.341085] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 652.341480] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.341480] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 652.341480] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 652.343442] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.343442] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.343442] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.343442] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.343686] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.343686] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.343781] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.343819] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.345104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.345104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.345104] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7176e416-370c-4ff8-be5b-5551a672ed01 already deleted. [ 652.345104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.370560] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 652.370560] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 652.370560] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 652.370560] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-605" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.370560] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-4a05a05b-a23b-4b49-867d-385c070dd563 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.370560] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-4a05a05b-a23b-4b49-867d-385c070dd563" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.370560] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-4a05a05b-a23b-4b49-867d-385c070dd563" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.370560] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-4a05a05b-a23b-4b49-867d-385c070dd563" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.370560] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a05a05b-a23b-4b49-867d-385c070dd563',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.486150] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('272acbad-bd3f-40f8-972f-dda18f503b74',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.581728] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.581937] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.582021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.582244] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.582323] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.582422] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c1d9931-fffd-4897-bf78-f61dac3e6bf3 already deleted. [ 652.582507] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c1d9931-fffd-4897-bf78-f61dac3e6bf3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.876240] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.876799] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.876799] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.877170] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.877343] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.877530] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 4a05a05b-a23b-4b49-867d-385c070dd563 not found, creating... [ 652.877881] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.878199] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.878339] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.879562] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.879687] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.880943] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.880943] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.880943] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.881386] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.881995] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.882248] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 4a05a05b-a23b-4b49-867d-385c070dd563 is going to be created. [ 652.922176] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.922589] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.922726] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.923120] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.923376] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.923638] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-4a05a05b-a23b-4b49-867d-385c070dd563" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.989899] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.990198] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.990198] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.990405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.990533] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.990620] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 272acbad-bd3f-40f8-972f-dda18f503b74 is going to be updated. [ 653.043375] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.043826] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.043967] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.044297] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.044545] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.064119] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 272acbad-bd3f-40f8-972f-dda18f503b74 in Status: IN_PROGRESS for 2s [ 653.651145] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea in Status: SUCCESS [ 653.652098] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.652098] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.652098] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.652098] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.652347] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.652347] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.652435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.652695] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.652695] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.652695] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('605734aa-d0fb-486b-9d2a-22c70d9dd0ea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.673531] env[66994]: INFO networking_nsxv3.common.synchronization [req-74e5bd95-b336-4ff8-ab93-2a419396bfbb req-a0151581-2cad-440c-91a9-7d54a3cd1a0f service nova] Enqueued Resource ID: 7176e416-370c-4ff8-be5b-5551a672ed01 with Priority: HIGHEST for action security_group_rules [ 653.673748] env[66994]: INFO networking_nsxv3.common.synchronization [req-74e5bd95-b336-4ff8-ab93-2a419396bfbb req-a0151581-2cad-440c-91a9-7d54a3cd1a0f service nova] Enqueued Resource ID: 7176e416-370c-4ff8-be5b-5551a672ed01 with Priority: HIGHEST for action security_group_members [ 653.673924] env[66994]: INFO networking_nsxv3.common.synchronization [req-74e5bd95-b336-4ff8-ab93-2a419396bfbb req-a0151581-2cad-440c-91a9-7d54a3cd1a0f service nova] Enqueued Resource ID: 4a05a05b-a23b-4b49-867d-385c070dd563 with Priority: HIGHEST for action port [ 653.674533] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7176e416-370c-4ff8-be5b-5551a672ed01 with Priority: HIGHEST for action security_group_rules [ 653.674707] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7176e416-370c-4ff8-be5b-5551a672ed01 with Priority: HIGHEST for action security_group_members [ 653.674825] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a05a05b-a23b-4b49-867d-385c070dd563 with Priority: HIGHEST for action port [ 653.675377] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7176e416-370c-4ff8-be5b-5551a672ed01 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.675513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.675802] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.675802] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.675926] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7176e416-370c-4ff8-be5b-5551a672ed01',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.678545] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-7176e416-370c-4ff8-be5b-5551a672ed01 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.678661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.678727] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.678922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.679161] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.679291] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.679380] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.679582] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.679673] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.679770] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7176e416-370c-4ff8-be5b-5551a672ed01',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.681460] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a05a05b-a23b-4b49-867d-385c070dd563 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.681460] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a05a05b-a23b-4b49-867d-385c070dd563" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.681460] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a05a05b-a23b-4b49-867d-385c070dd563" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.681460] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a05a05b-a23b-4b49-867d-385c070dd563" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.681460] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a05a05b-a23b-4b49-867d-385c070dd563',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.155951] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.155951] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.155951] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.156372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.156372] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.156472] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.156472] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.157405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.157405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.157405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.157405] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.157405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.157405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.157405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.157823] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.157823] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.157823] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.157943] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.157943] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.158019] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.158115] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('605734aa-d0fb-486b-9d2a-22c70d9dd0ea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.185026] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-7176e416-370c-4ff8-be5b-5551a672ed01 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.185026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.185026] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7176e416-370c-4ff8-be5b-5551a672ed01',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.185026] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a05a05b-a23b-4b49-867d-385c070dd563 with status ACTIVE [ 654.186111] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.186111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.186111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.186111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.186111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.186111] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.186111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.190039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.190039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.190039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.190039] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.190039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.190039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.190039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.190039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.190039] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a05a05b-a23b-4b49-867d-385c070dd563 is going to be updated. [ 654.213676] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.213984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.213984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.214321] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.215801] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.216061] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a05a05b-a23b-4b49-867d-385c070dd563" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.289071] env[66994]: INFO networking_nsxv3.common.synchronization [req-18103bd5-97cb-4a76-96ae-ef4ad3b7c929 req-0a9eade7-576e-4fdc-8e56-36d4e64de7e8 tempest-ListServerFiltersTestJSON-483871491 tempest-ListServerFiltersTestJSON-483871491-project-member] Enqueued Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_members [ 654.290307] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_members [ 654.291925] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.291925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.291925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.292217] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.292855] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.292855] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.292855] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.292855] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.292855] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.293431] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.663741] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 605734aa-d0fb-486b-9d2a-22c70d9dd0ea: rpc.has_security_group_logging(os_id): False [ 654.666619] env[66994]: INFO networking_nsxv3.common.synchronization [None req-8b7dd60d-1fd4-4c2f-b4e2-a66b279492eb None None] Enqueued Resource ID: 0232bdda-6304-43ad-9082-33cdaf65e77a with Priority: HIGHEST for action port [ 654.667271] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0232bdda-6304-43ad-9082-33cdaf65e77a with Priority: HIGHEST for action port [ 654.667754] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-0232bdda-6304-43ad-9082-33cdaf65e77a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.667878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0232bdda-6304-43ad-9082-33cdaf65e77a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.667942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0232bdda-6304-43ad-9082-33cdaf65e77a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.668279] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0232bdda-6304-43ad-9082-33cdaf65e77a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.668341] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0232bdda-6304-43ad-9082-33cdaf65e77a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.685741] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.685945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.685945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.686165] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.686843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.686843] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.686843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.686843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.686843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.687214] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.687214] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.687214] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.687338] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.687441] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.687494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.687635] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.687730] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.687791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.687926] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.688379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.692197] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea is going to be updated. [ 654.694530] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7176e416-370c-4ff8-be5b-5551a672ed01',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.761104] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.761257] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.761301] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.761515] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.761660] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.777880] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea in Status: IN_PROGRESS for 2s [ 654.797607] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.076921] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 272acbad-bd3f-40f8-972f-dda18f503b74 in Status: SUCCESS [ 655.076921] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.077279] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.077522] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.077710] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.077833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.077890] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.078103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.078190] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.078279] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.078370] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('272acbad-bd3f-40f8-972f-dda18f503b74',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.170805] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0232bdda-6304-43ad-9082-33cdaf65e77a [ 655.171187] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.171266] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.171321] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.171847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.171847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.171847] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0232bdda-6304-43ad-9082-33cdaf65e77a already deleted. [ 655.171847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0232bdda-6304-43ad-9082-33cdaf65e77a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.202691] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.203742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.203742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.203742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.203742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.203988] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7176e416-370c-4ff8-be5b-5551a672ed01 is going to be created. [ 655.230311] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.230469] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.230545] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.230736] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.230909] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.241589] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7176e416-370c-4ff8-be5b-5551a672ed01 in Status: UNINITIALIZED for 2s [ 655.305207] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.445966] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.446669] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-608" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.446669] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-608" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.447086] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-608" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.448183] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.448183] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.448395] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.448572] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.448756] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.448998] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 655.449166] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 655.449301] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 655.449417] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 655.449547] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 655.449677] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 655.449836] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 655.473463] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 655.473640] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 655.475906] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 655.476949] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-608" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.476949] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-593d8fab-754d-41b6-86ae-dac26da25737 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.476949] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-593d8fab-754d-41b6-86ae-dac26da25737" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.476949] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-593d8fab-754d-41b6-86ae-dac26da25737" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.477238] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-593d8fab-754d-41b6-86ae-dac26da25737" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.477364] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('593d8fab-754d-41b6-86ae-dac26da25737',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.584412] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-272acbad-bd3f-40f8-972f-dda18f503b74 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.584628] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.584675] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.584857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.585039] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.585147] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.585209] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.585369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.585458] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.585621] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.585778] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-272acbad-bd3f-40f8-972f-dda18f503b74 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.585873] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.585934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.586095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.586249] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.586363] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.586421] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.586520] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.586593] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.586697] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.586760] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('272acbad-bd3f-40f8-972f-dda18f503b74',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.811255] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.811255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.813383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.813650] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.813800] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.813878] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb is going to be updated. [ 655.846887] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.846887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.846887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.847235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.847235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.865972] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: IN_PROGRESS for 2s [ 655.981636] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.982317] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.982317] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.982459] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.982643] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.982852] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 593d8fab-754d-41b6-86ae-dac26da25737 not found, creating... [ 655.983225] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.983427] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.983587] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.983877] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.984698] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.984698] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.984698] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.984977] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.985046] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.985703] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.985703] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 593d8fab-754d-41b6-86ae-dac26da25737 is going to be created. [ 656.008313] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.008840] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.008932] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.009417] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.009784] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.010161] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-593d8fab-754d-41b6-86ae-dac26da25737" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.089876] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 272acbad-bd3f-40f8-972f-dda18f503b74: rpc.has_security_group_logging(os_id): False [ 656.133841] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.133841] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.133841] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.133841] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.134428] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.134428] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.134428] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.134546] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.134730] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.134948] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.135188] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.135421] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.135581] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.135837] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.135994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.136307] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.136460] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.136614] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.136884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.137228] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.137312] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 272acbad-bd3f-40f8-972f-dda18f503b74 is going to be updated. [ 656.232483] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.232918] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.232918] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.232918] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.233104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.246172] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 272acbad-bd3f-40f8-972f-dda18f503b74 in Status: IN_PROGRESS for 2s [ 656.782345] env[66994]: INFO networking_nsxv3.common.synchronization [req-18103bd5-97cb-4a76-96ae-ef4ad3b7c929 req-192b1572-360c-4ad2-acde-e3e8e1fc9a21 service nova] Enqueued Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_rules [ 656.782590] env[66994]: INFO networking_nsxv3.common.synchronization [req-18103bd5-97cb-4a76-96ae-ef4ad3b7c929 req-192b1572-360c-4ad2-acde-e3e8e1fc9a21 service nova] Enqueued Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_members [ 656.782671] env[66994]: INFO networking_nsxv3.common.synchronization [req-18103bd5-97cb-4a76-96ae-ef4ad3b7c929 req-192b1572-360c-4ad2-acde-e3e8e1fc9a21 service nova] Enqueued Resource ID: 593d8fab-754d-41b6-86ae-dac26da25737 with Priority: HIGHEST for action port [ 656.783989] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_rules [ 656.784190] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_members [ 656.784329] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593d8fab-754d-41b6-86ae-dac26da25737 with Priority: HIGHEST for action port [ 656.784635] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.784767] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.784832] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.785197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.785360] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.786369] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.786369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.786564] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-593d8fab-754d-41b6-86ae-dac26da25737 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.786978] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-593d8fab-754d-41b6-86ae-dac26da25737" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.787063] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-593d8fab-754d-41b6-86ae-dac26da25737" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.787507] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-593d8fab-754d-41b6-86ae-dac26da25737" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.787507] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('593d8fab-754d-41b6-86ae-dac26da25737',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.798361] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea in Status: SUCCESS [ 656.798745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.255688] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7176e416-370c-4ff8-be5b-5551a672ed01 in Status: SUCCESS [ 657.255688] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.255688] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.256358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.256715] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.256941] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.257031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.257233] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.257367] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.257414] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.257522] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7176e416-370c-4ff8-be5b-5551a672ed01',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.290765] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.290765] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.290765] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 593d8fab-754d-41b6-86ae-dac26da25737 with status ACTIVE [ 657.291223] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.291223] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.291223] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.291507] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.291507] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.291610] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.291720] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.291776] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.291950] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.292042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.292410] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.292410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.292410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.292606] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.292606] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.292750] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 593d8fab-754d-41b6-86ae-dac26da25737 is going to be updated. [ 657.339163] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.339163] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.339312] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.339517] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.339716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.339925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-593d8fab-754d-41b6-86ae-dac26da25737" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.760747] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7176e416-370c-4ff8-be5b-5551a672ed01',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.881578] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: SUCCESS [ 657.882139] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.883468] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.883468] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.883468] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.883468] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.883468] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.883679] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.883724] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.883849] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.227082] env[66994]: INFO networking_nsxv3.common.synchronization [None req-9ea139f0-e800-49bb-ba93-be4edcfce4f2 None None] Enqueued Resource ID: 702213ef-b44e-4b1a-80fb-7237da137c1a with Priority: HIGHEST for action port [ 658.227569] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 702213ef-b44e-4b1a-80fb-7237da137c1a with Priority: HIGHEST for action port [ 658.227969] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-702213ef-b44e-4b1a-80fb-7237da137c1a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.228113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-702213ef-b44e-4b1a-80fb-7237da137c1a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.229417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-702213ef-b44e-4b1a-80fb-7237da137c1a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.229694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-702213ef-b44e-4b1a-80fb-7237da137c1a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.229779] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('702213ef-b44e-4b1a-80fb-7237da137c1a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.264234] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 272acbad-bd3f-40f8-972f-dda18f503b74 in Status: SUCCESS [ 658.264504] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.265143] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7176e416-370c-4ff8-be5b-5551a672ed01: rpc.has_security_group_logging(os_id): False [ 658.288783] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.288989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.289095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.289502] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.289759] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.290323] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.290595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.290747] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.291446] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.292053] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.292053] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7176e416-370c-4ff8-be5b-5551a672ed01 is going to be created. [ 658.387552] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.392202] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.392202] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.392202] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.392202] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.392202] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.410348] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7176e416-370c-4ff8-be5b-5551a672ed01 in Status: IN_PROGRESS for 2s [ 658.735038] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 702213ef-b44e-4b1a-80fb-7237da137c1a [ 658.735038] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.735038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.735038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.735038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.735038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.735470] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:702213ef-b44e-4b1a-80fb-7237da137c1a already deleted. [ 658.735470] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-702213ef-b44e-4b1a-80fb-7237da137c1a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.895175] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.377550] env[66994]: INFO networking_nsxv3.common.synchronization [req-369d2625-a8ad-4069-b9b6-0f55b114c99f req-a1901193-2030-4019-821d-1d75ca25b5d5 tempest-ServerRescueTestJSON-1208691686 tempest-ServerRescueTestJSON-1208691686-project-member] Enqueued Resource ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f with Priority: HIGHEST for action security_group_members [ 659.378437] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f with Priority: HIGHEST for action security_group_members [ 659.379368] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5a17dbe-38a0-49a6-88df-5879a5d5333f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.379538] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.379602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.379875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.380272] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.380272] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.380272] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.380506] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.380506] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.380617] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.404720] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.406745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.406745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.406745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.406745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.406745] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb is going to be updated. [ 659.413509] env[66994]: INFO networking_nsxv3.common.synchronization [req-7cee3e73-bf6a-4d32-9551-e0f1539cec1b req-9f8c5724-0986-4d5f-9e67-09d146b91516 tempest-InstanceActionsV221TestJSON-1907997106 tempest-InstanceActionsV221TestJSON-1907997106-project-member] Enqueued Resource ID: f2f71bab-7256-4f84-bd3c-ad2bf1145250 with Priority: HIGHEST for action security_group_members [ 659.414119] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2f71bab-7256-4f84-bd3c-ad2bf1145250 with Priority: HIGHEST for action security_group_members [ 659.414448] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2f71bab-7256-4f84-bd3c-ad2bf1145250 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.415163] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.415358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.416287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.416490] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.416599] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.417240] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.417240] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.417240] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.417240] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2f71bab-7256-4f84-bd3c-ad2bf1145250',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.439154] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.439324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.439378] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.440131] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.440131] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.452333] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: IN_PROGRESS for 2s [ 659.886429] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.886597] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.886651] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.886887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.886975] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.889637] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.889637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.889637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.889637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.889637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.889637] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f already deleted. [ 659.889637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.918947] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.918947] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-876" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.919235] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-876" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.921556] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-876" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.921556] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.921556] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.921556] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.921556] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.921556] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.921556] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.921556] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.925066] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.925066] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.925066] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.925066] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.925066] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.926478] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.926762] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.926926] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.927225] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.927416] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.928583] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.928583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.930026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.930026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.930026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.930026] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2f71bab-7256-4f84-bd3c-ad2bf1145250 is going to be updated. [ 659.960778] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.960778] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 659.960778] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.960778] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-876" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.960778] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-94a080c5-1d15-469e-8f78-4dd60a172db5 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.960778] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-94a080c5-1d15-469e-8f78-4dd60a172db5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.960778] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-94a080c5-1d15-469e-8f78-4dd60a172db5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.960778] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-94a080c5-1d15-469e-8f78-4dd60a172db5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.960778] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94a080c5-1d15-469e-8f78-4dd60a172db5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.969391] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.969603] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.969650] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.969922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.970055] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.983962] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2f71bab-7256-4f84-bd3c-ad2bf1145250 in Status: IN_PROGRESS for 2s [ 660.426120] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7176e416-370c-4ff8-be5b-5551a672ed01 in Status: SUCCESS [ 660.426120] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.465539] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.465539] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.465539] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.465539] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.465539] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.465539] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 94a080c5-1d15-469e-8f78-4dd60a172db5 not found, creating... [ 660.467668] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.467668] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.467668] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.467668] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.467668] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.468604] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.471314] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.471314] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.471314] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.471314] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.471314] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 94a080c5-1d15-469e-8f78-4dd60a172db5 is going to be created. [ 660.498496] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.498496] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.498496] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.498496] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.498496] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.499606] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-94a080c5-1d15-469e-8f78-4dd60a172db5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.228107] env[66994]: INFO networking_nsxv3.common.synchronization [req-369d2625-a8ad-4069-b9b6-0f55b114c99f req-4baec9a7-451d-4299-9751-6497f3c85404 service nova] Enqueued Resource ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f with Priority: HIGHEST for action security_group_rules [ 661.228287] env[66994]: INFO networking_nsxv3.common.synchronization [req-369d2625-a8ad-4069-b9b6-0f55b114c99f req-4baec9a7-451d-4299-9751-6497f3c85404 service nova] Enqueued Resource ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f with Priority: HIGHEST for action security_group_members [ 661.228418] env[66994]: INFO networking_nsxv3.common.synchronization [req-369d2625-a8ad-4069-b9b6-0f55b114c99f req-4baec9a7-451d-4299-9751-6497f3c85404 service nova] Enqueued Resource ID: 94a080c5-1d15-469e-8f78-4dd60a172db5 with Priority: HIGHEST for action port [ 661.228930] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f with Priority: HIGHEST for action security_group_rules [ 661.229077] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f with Priority: HIGHEST for action security_group_members [ 661.229235] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a080c5-1d15-469e-8f78-4dd60a172db5 with Priority: HIGHEST for action port [ 661.229551] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5a17dbe-38a0-49a6-88df-5879a5d5333f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.229677] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.229743] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.229995] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.232824] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.232824] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5a17dbe-38a0-49a6-88df-5879a5d5333f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.232824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.232824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.232824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.232824] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.232824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.232824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.232824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.232824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.232824] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.234917] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-94a080c5-1d15-469e-8f78-4dd60a172db5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.235290] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94a080c5-1d15-469e-8f78-4dd60a172db5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.235290] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94a080c5-1d15-469e-8f78-4dd60a172db5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.235740] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94a080c5-1d15-469e-8f78-4dd60a172db5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.235740] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94a080c5-1d15-469e-8f78-4dd60a172db5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.465226] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: SUCCESS [ 661.465611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.465655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.466066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.466066] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.466614] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.466614] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.466614] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.466614] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.466614] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.466789] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.737519] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.738738] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5a17dbe-38a0-49a6-88df-5879a5d5333f taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.738898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.739013] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94a080c5-1d15-469e-8f78-4dd60a172db5 with status ACTIVE [ 661.739176] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.739286] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.739365] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.739619] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.739713] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.739883] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.739984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.740052] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.740211] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.740282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.740453] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.741340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.741340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.741340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.741340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.741340] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94a080c5-1d15-469e-8f78-4dd60a172db5 is going to be updated. [ 661.774967] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.775142] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.775252] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.775431] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.775563] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.775721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94a080c5-1d15-469e-8f78-4dd60a172db5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.969080] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.969505] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.969651] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.969876] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.970068] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.970190] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.970474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.970621] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.970662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.970734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.970896] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.971044] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.971111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.971245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.971391] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.971482] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.971550] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.971713] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.972168] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.972168] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.972168] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.995256] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2f71bab-7256-4f84-bd3c-ad2bf1145250 in Status: SUCCESS [ 661.995422] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2f71bab-7256-4f84-bd3c-ad2bf1145250 deletion is rescheduled due to dependency. [ 661.995532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.244210] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.445953] env[66994]: INFO networking_nsxv3.common.synchronization [None req-224179c3-8058-49de-9dd6-d69456b857c8 None None] Enqueued Resource ID: e40f4a41-3a28-47a6-8657-c30686653253 with Priority: HIGHEST for action port [ 662.447668] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e40f4a41-3a28-47a6-8657-c30686653253 with Priority: HIGHEST for action port [ 662.448379] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-e40f4a41-3a28-47a6-8657-c30686653253 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.449303] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e40f4a41-3a28-47a6-8657-c30686653253" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.449303] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e40f4a41-3a28-47a6-8657-c30686653253" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.450085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e40f4a41-3a28-47a6-8657-c30686653253" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.450085] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e40f4a41-3a28-47a6-8657-c30686653253',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.474339] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ca0171b-7165-4d45-aa70-8fe66df074eb: rpc.has_security_group_logging(os_id): False [ 662.497034] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.497034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.497034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.497034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.497034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.497034] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.497034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.497034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.497525] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.497525] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.497589] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.497642] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.498881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.498881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.498881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.498881] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.498881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.498881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.498881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.498881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.498881] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb is going to be updated. [ 662.599548] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.599752] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.599797] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.600249] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.600249] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.619532] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: IN_PROGRESS for 2s [ 662.747055] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.747336] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.747502] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.747786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.747898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.748022] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f is going to be created. [ 662.795693] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.795932] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.796107] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.796838] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.796838] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.810994] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f in Status: UNINITIALIZED for 2s [ 662.953675] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e40f4a41-3a28-47a6-8657-c30686653253 [ 662.953979] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.954216] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.954375] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.954610] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.954771] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.954887] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e40f4a41-3a28-47a6-8657-c30686653253 already deleted. [ 662.954977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e40f4a41-3a28-47a6-8657-c30686653253" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.574224] env[66994]: INFO networking_nsxv3.common.synchronization [None req-85423f76-1409-4517-b210-c9c852dce5be None None] Enqueued Resource ID: 04651664-dbe6-434b-977d-984cc43bbe40 with Priority: HIGHEST for action port [ 663.574224] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04651664-dbe6-434b-977d-984cc43bbe40 with Priority: HIGHEST for action port [ 663.574224] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-04651664-dbe6-434b-977d-984cc43bbe40 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.574711] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04651664-dbe6-434b-977d-984cc43bbe40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.574711] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04651664-dbe6-434b-977d-984cc43bbe40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.574711] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04651664-dbe6-434b-977d-984cc43bbe40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.574711] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04651664-dbe6-434b-977d-984cc43bbe40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.583846] env[66994]: INFO networking_nsxv3.common.synchronization [req-e4f4bd76-797e-4493-bae1-1814c0b397c1 req-248d0639-e047-4825-8f68-71ece470ff72 tempest-ServersAdminTestJSON-1722983547 tempest-ServersAdminTestJSON-1722983547-project-member] Enqueued Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 663.584459] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 663.586174] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.586174] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.586174] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.586174] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.586174] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.586174] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.586174] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.586174] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.586174] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.586174] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.058030] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-237 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.058383] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.058540] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.058894] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.059369] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.059581] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.059728] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.060010] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.060292] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.060467] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.060611] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 664.060746] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 664.060882] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 664.061039] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.061178] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 664.061336] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 664.082718] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04651664-dbe6-434b-977d-984cc43bbe40 [ 664.082718] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.082718] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.083047] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.083047] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.083200] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.083289] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04651664-dbe6-434b-977d-984cc43bbe40 already deleted. [ 664.083375] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04651664-dbe6-434b-977d-984cc43bbe40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.088355] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.092389] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 664.092389] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 664.092389] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 664.092389] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.092389] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-ce572c5d-cc8b-441b-9df7-a6201aa5fcf2 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.092389] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-ce572c5d-cc8b-441b-9df7-a6201aa5fcf2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.092389] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-ce572c5d-cc8b-441b-9df7-a6201aa5fcf2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.092389] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-ce572c5d-cc8b-441b-9df7-a6201aa5fcf2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.092389] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce572c5d-cc8b-441b-9df7-a6201aa5fcf2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.596467] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.596467] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.596467] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.596467] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.596467] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.596467] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.596467] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port ce572c5d-cc8b-441b-9df7-a6201aa5fcf2 not found, creating... [ 664.597691] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.597691] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.597691] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.597691] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.597691] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.597954] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.598033] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.598131] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.601097] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.601097] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.601097] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: ce572c5d-cc8b-441b-9df7-a6201aa5fcf2 is going to be created. [ 664.606187] env[66994]: INFO networking_nsxv3.common.synchronization [req-f93afe1b-db3f-4a41-8cfb-32415180492e req-00b8eabc-4fa4-45f3-8347-c7d87f217356 tempest-SecurityGroupRulesTestJSON-2081492605 tempest-SecurityGroupRulesTestJSON-2081492605-project-member] Enqueued Resource ID: 0d347089-3615-4db5-a2a3-9456195b17eb with Priority: HIGHEST for action security_group_rules [ 664.606884] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d347089-3615-4db5-a2a3-9456195b17eb with Priority: HIGHEST for action security_group_rules [ 664.608936] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d347089-3615-4db5-a2a3-9456195b17eb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.609101] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d347089-3615-4db5-a2a3-9456195b17eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.609171] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d347089-3615-4db5-a2a3-9456195b17eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.609512] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d347089-3615-4db5-a2a3-9456195b17eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.609620] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d347089-3615-4db5-a2a3-9456195b17eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.626886] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.627860] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.628068] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.628381] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.629778] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.630047] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-ce572c5d-cc8b-441b-9df7-a6201aa5fcf2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.641715] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: SUCCESS [ 664.641715] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.833021] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f in Status: SUCCESS [ 664.833021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.833021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.833021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.833021] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.833021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.833021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.833021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.833021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.833021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.833021] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.101992] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.102228] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.102305] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.102536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.102636] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.102838] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 is going to be updated. [ 665.136933] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.137161] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.137292] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.137649] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.138951] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.138951] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d347089-3615-4db5-a2a3-9456195b17eb already deleted. [ 665.138951] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d347089-3615-4db5-a2a3-9456195b17eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.139463] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.139716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.139716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.139838] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.140386] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.150866] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: IN_PROGRESS for 2s [ 665.338474] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5a17dbe-38a0-49a6-88df-5879a5d5333f taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.338474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.338474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.338474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.338474] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.338474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.338474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.338474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.338474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.338474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.338474] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5a17dbe-38a0-49a6-88df-5879a5d5333f taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.338474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.338474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.338474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.338474] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.338474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.339443] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.339443] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.339443] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.339443] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.341597] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.416943] env[66994]: INFO networking_nsxv3.common.synchronization [req-e4f4bd76-797e-4493-bae1-1814c0b397c1 req-e613851b-183c-4df4-8ab2-cc0dfb738a67 service nova] Enqueued Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_rules [ 665.417151] env[66994]: INFO networking_nsxv3.common.synchronization [req-e4f4bd76-797e-4493-bae1-1814c0b397c1 req-e613851b-183c-4df4-8ab2-cc0dfb738a67 service nova] Enqueued Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 665.417319] env[66994]: INFO networking_nsxv3.common.synchronization [req-e4f4bd76-797e-4493-bae1-1814c0b397c1 req-e613851b-183c-4df4-8ab2-cc0dfb738a67 service nova] Enqueued Resource ID: ce572c5d-cc8b-441b-9df7-a6201aa5fcf2 with Priority: HIGHEST for action port [ 665.417904] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_rules [ 665.418569] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 665.419435] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce572c5d-cc8b-441b-9df7-a6201aa5fcf2 with Priority: HIGHEST for action port [ 665.419435] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.419435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.419435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.419684] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.419684] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.420962] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.421077] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.421278] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce572c5d-cc8b-441b-9df7-a6201aa5fcf2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.421795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce572c5d-cc8b-441b-9df7-a6201aa5fcf2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.421795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce572c5d-cc8b-441b-9df7-a6201aa5fcf2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.421795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce572c5d-cc8b-441b-9df7-a6201aa5fcf2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.421795] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce572c5d-cc8b-441b-9df7-a6201aa5fcf2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.844027] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5a17dbe-38a0-49a6-88df-5879a5d5333f: rpc.has_security_group_logging(os_id): False [ 665.867094] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.867266] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.867361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.867634] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.867753] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.867999] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.868152] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.868223] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.868417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.868515] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.868733] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.869369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.869460] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.869642] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.869728] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.869955] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.870093] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.870161] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.870332] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.870410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.870524] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f is going to be created. [ 665.923617] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.923887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.923959] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce572c5d-cc8b-441b-9df7-a6201aa5fcf2 with status ACTIVE [ 665.924234] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.924359] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.924427] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.924641] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.924729] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.924920] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.925114] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.925175] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.925299] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.925909] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.925909] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.925909] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.925909] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.925909] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.925909] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.926239] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce572c5d-cc8b-441b-9df7-a6201aa5fcf2 is going to be updated. [ 665.939403] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.939578] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.939626] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.939902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.940594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.952649] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f in Status: IN_PROGRESS for 2s [ 665.954143] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.954385] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.954463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.954686] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.954824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.955127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce572c5d-cc8b-441b-9df7-a6201aa5fcf2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.355270] env[66994]: INFO networking_nsxv3.common.synchronization [None req-c6473dcb-81a7-42ed-9725-d7304aed0267 None None] Enqueued Resource ID: 5ef4a229-5bf6-4cd0-b021-18d010f2ecb2 with Priority: HIGHEST for action port [ 666.355930] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ef4a229-5bf6-4cd0-b021-18d010f2ecb2 with Priority: HIGHEST for action port [ 666.356282] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ef4a229-5bf6-4cd0-b021-18d010f2ecb2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.356472] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ef4a229-5bf6-4cd0-b021-18d010f2ecb2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.356472] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ef4a229-5bf6-4cd0-b021-18d010f2ecb2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.356758] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ef4a229-5bf6-4cd0-b021-18d010f2ecb2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.356844] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ef4a229-5bf6-4cd0-b021-18d010f2ecb2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.863030] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ef4a229-5bf6-4cd0-b021-18d010f2ecb2 [ 666.863030] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.863030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.863030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.863030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.863030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.863030] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ef4a229-5bf6-4cd0-b021-18d010f2ecb2 already deleted. [ 666.863030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ef4a229-5bf6-4cd0-b021-18d010f2ecb2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.167258] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: SUCCESS [ 667.167494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.167679] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.167971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.168203] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.168339] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.168420] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.168595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.168678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.168806] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.671768] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.977179] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f in Status: SUCCESS [ 667.977468] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.173825] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.421071] env[66994]: INFO networking_nsxv3.common.synchronization [None req-37d626ae-af15-4910-8c69-3dcd3717f9f8 None None] Enqueued Resource ID: a6c48995-c88d-4335-9c05-4c911a15fb58 with Priority: HIGHEST for action port [ 668.421480] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6c48995-c88d-4335-9c05-4c911a15fb58 with Priority: HIGHEST for action port [ 668.421956] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6c48995-c88d-4335-9c05-4c911a15fb58 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.422383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6c48995-c88d-4335-9c05-4c911a15fb58" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.422383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6c48995-c88d-4335-9c05-4c911a15fb58" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.422832] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6c48995-c88d-4335-9c05-4c911a15fb58" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.423028] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6c48995-c88d-4335-9c05-4c911a15fb58',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.677903] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.678114] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.678177] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.678399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.678499] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.678605] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 is going to be updated. [ 668.714906] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.715146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.715146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.715591] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.715591] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.728837] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: IN_PROGRESS for 2s [ 668.805179] env[66994]: INFO networking_nsxv3.common.synchronization [req-036d451c-ee27-4760-b26a-467329454c1d req-a9f9a295-54a3-49d1-a79e-9c539210904d tempest-MultipleCreateTestJSON-651107876 tempest-MultipleCreateTestJSON-651107876-project-member] Enqueued Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 668.805179] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 668.805582] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.805774] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.805861] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.806118] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.806315] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.806555] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.806647] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.806876] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.807103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.807228] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.927810] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6c48995-c88d-4335-9c05-4c911a15fb58 [ 668.927810] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.927810] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.927810] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.927810] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.927810] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.928218] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6c48995-c88d-4335-9c05-4c911a15fb58 already deleted. [ 668.928218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6c48995-c88d-4335-9c05-4c911a15fb58" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.261249] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-116 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.261249] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-116" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.261249] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-116" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.261812] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-116" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.262018] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.262222] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.262342] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.262598] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.262742] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.262950] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.263189] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.263348] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.263459] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.263577] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.263686] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.263808] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.283301] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.284344] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 669.284344] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.284344] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-116" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.284344] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-37a12fa3-f0c8-43b8-a45a-022f8be67c0c taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.284624] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-37a12fa3-f0c8-43b8-a45a-022f8be67c0c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.284624] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-37a12fa3-f0c8-43b8-a45a-022f8be67c0c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.284883] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-37a12fa3-f0c8-43b8-a45a-022f8be67c0c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.285043] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37a12fa3-f0c8-43b8-a45a-022f8be67c0c',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.309381] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.309572] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.309646] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.309922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.310036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.310237] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.310352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.310410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.310580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.310656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.310740] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 already deleted. [ 669.310818] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.787291] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.787584] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.787717] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.788017] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.788181] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.788356] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 37a12fa3-f0c8-43b8-a45a-022f8be67c0c not found, creating... [ 669.788643] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.788798] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.788902] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.789133] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.789265] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.789604] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.789759] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.789867] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.790100] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.790231] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.790367] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 37a12fa3-f0c8-43b8-a45a-022f8be67c0c is going to be created. [ 669.811778] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.812020] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.812205] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.812432] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.812629] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.812890] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-37a12fa3-f0c8-43b8-a45a-022f8be67c0c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.554405] env[66994]: INFO networking_nsxv3.common.synchronization [req-036d451c-ee27-4760-b26a-467329454c1d req-98cd40fa-5e1a-49f9-95d3-b4486df5b810 service nova] Enqueued Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_rules [ 670.554753] env[66994]: INFO networking_nsxv3.common.synchronization [req-036d451c-ee27-4760-b26a-467329454c1d req-98cd40fa-5e1a-49f9-95d3-b4486df5b810 service nova] Enqueued Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 670.554753] env[66994]: INFO networking_nsxv3.common.synchronization [req-036d451c-ee27-4760-b26a-467329454c1d req-98cd40fa-5e1a-49f9-95d3-b4486df5b810 service nova] Enqueued Resource ID: 37a12fa3-f0c8-43b8-a45a-022f8be67c0c with Priority: HIGHEST for action port [ 670.555618] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_rules [ 670.555618] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 670.555618] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37a12fa3-f0c8-43b8-a45a-022f8be67c0c with Priority: HIGHEST for action port [ 670.555939] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.555939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.555939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.556587] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.556587] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.557101] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.557782] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.557782] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.557971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.558025] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.558128] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.558614] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.558614] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.558614] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.558614] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.559262] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-37a12fa3-f0c8-43b8-a45a-022f8be67c0c taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.559371] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37a12fa3-f0c8-43b8-a45a-022f8be67c0c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.559439] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37a12fa3-f0c8-43b8-a45a-022f8be67c0c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.559589] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37a12fa3-f0c8-43b8-a45a-022f8be67c0c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.559685] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37a12fa3-f0c8-43b8-a45a-022f8be67c0c',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.742732] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: SUCCESS [ 670.742963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.743157] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.743423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.743631] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.743773] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.743842] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.744017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.744098] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.744210] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.744322] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.915249] env[66994]: INFO networking_nsxv3.common.synchronization [None req-9eb509bf-ec4a-43a3-a159-dc0cebad4e3e None None] Enqueued Resource ID: 6e986beb-7f07-4dfd-b9b5-8ec9086d54fc with Priority: HIGHEST for action port [ 670.915905] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e986beb-7f07-4dfd-b9b5-8ec9086d54fc with Priority: HIGHEST for action port [ 670.916272] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e986beb-7f07-4dfd-b9b5-8ec9086d54fc taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.916402] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e986beb-7f07-4dfd-b9b5-8ec9086d54fc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.916979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e986beb-7f07-4dfd-b9b5-8ec9086d54fc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.917410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e986beb-7f07-4dfd-b9b5-8ec9086d54fc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.917657] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e986beb-7f07-4dfd-b9b5-8ec9086d54fc',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.061246] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.061624] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.061624] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.062474] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 37a12fa3-f0c8-43b8-a45a-022f8be67c0c with status ACTIVE [ 671.062660] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.062776] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.062838] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.063060] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.063206] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.063400] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.063519] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.063586] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.064391] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.064543] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.064727] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.064858] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.064941] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.065129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.065250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.065386] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 37a12fa3-f0c8-43b8-a45a-022f8be67c0c is going to be updated. [ 671.089628] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.089897] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.089972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.090204] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.090391] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.090564] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37a12fa3-f0c8-43b8-a45a-022f8be67c0c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.247062] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.247226] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.247301] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.247575] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.247793] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.247930] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.248066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.248659] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.248659] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.248659] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.248659] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.248659] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.248986] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.248986] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.248986] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.249174] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.249174] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.249293] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.249381] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.249489] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.252423] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.420400] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6e986beb-7f07-4dfd-b9b5-8ec9086d54fc [ 671.420762] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.421079] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.421383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.421585] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.421585] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.421740] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6e986beb-7f07-4dfd-b9b5-8ec9086d54fc already deleted. [ 671.421740] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e986beb-7f07-4dfd-b9b5-8ec9086d54fc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.567963] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.655344] env[66994]: INFO networking_nsxv3.common.synchronization [req-036d451c-ee27-4760-b26a-467329454c1d req-f7c1004b-0f90-4420-9cf6-50911d1a2b97 tempest-MultipleCreateTestJSON-651107876 tempest-MultipleCreateTestJSON-651107876-project-member] Enqueued Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 671.655961] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 671.656272] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.656370] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.760172] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5dbec57c-866e-4292-acf4-6de3635c21b3: rpc.has_security_group_logging(os_id): False [ 671.780182] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.780182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.780182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.780182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.780182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.780182] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.780182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.780182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.780182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.780182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.780182] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.780712] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.780712] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.780712] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.780712] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.780712] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.780901] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.780901] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.780978] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.783027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.783027] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 is going to be updated. [ 671.849373] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.851082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.851175] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.851399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.851572] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.872132] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: IN_PROGRESS for 2s [ 672.050270] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-116 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.050445] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-116" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.050562] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-116" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.051157] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-116" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.051459] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.051590] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.051948] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.052149] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.052314] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.052526] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.053586] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 672.053586] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 672.053586] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 672.053586] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.053586] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 672.053586] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 672.072217] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.072217] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.072217] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.072217] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.072217] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.072217] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 is going to be created. [ 672.074667] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 672.074865] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 672.076484] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 672.076484] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-116" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.076484] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-a30eb853-c461-43e4-b1aa-ee90aa7c5e37 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.076484] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-a30eb853-c461-43e4-b1aa-ee90aa7c5e37" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.076484] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-a30eb853-c461-43e4-b1aa-ee90aa7c5e37" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.076484] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-a30eb853-c461-43e4-b1aa-ee90aa7c5e37" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.076818] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a30eb853-c461-43e4-b1aa-ee90aa7c5e37',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.105713] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.105837] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.105887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.106130] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.106315] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.119031] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: UNINITIALIZED for 2s [ 672.579641] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.579990] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.580094] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.580424] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.580590] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.580766] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port a30eb853-c461-43e4-b1aa-ee90aa7c5e37 not found, creating... [ 672.581095] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.581330] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.581472] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.581753] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.581936] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.582683] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.582911] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.583074] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.583389] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.583556] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.583768] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: a30eb853-c461-43e4-b1aa-ee90aa7c5e37 is going to be created. [ 672.626161] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.626437] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.626564] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.626858] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.627093] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.627342] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-a30eb853-c461-43e4-b1aa-ee90aa7c5e37" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.374131] env[66994]: INFO networking_nsxv3.common.synchronization [req-036d451c-ee27-4760-b26a-467329454c1d req-fb42ddd5-2438-40ab-b4d9-1fbda30097a9 service nova] Enqueued Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_rules [ 673.374509] env[66994]: INFO networking_nsxv3.common.synchronization [req-036d451c-ee27-4760-b26a-467329454c1d req-fb42ddd5-2438-40ab-b4d9-1fbda30097a9 service nova] Enqueued Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 673.374680] env[66994]: INFO networking_nsxv3.common.synchronization [req-036d451c-ee27-4760-b26a-467329454c1d req-fb42ddd5-2438-40ab-b4d9-1fbda30097a9 service nova] Enqueued Resource ID: a30eb853-c461-43e4-b1aa-ee90aa7c5e37 with Priority: HIGHEST for action port [ 673.375398] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_rules [ 673.375569] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 673.375704] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a30eb853-c461-43e4-b1aa-ee90aa7c5e37 with Priority: HIGHEST for action port [ 673.376071] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.376194] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.376559] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.376559] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.376884] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-a30eb853-c461-43e4-b1aa-ee90aa7c5e37 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.376884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a30eb853-c461-43e4-b1aa-ee90aa7c5e37" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.377112] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a30eb853-c461-43e4-b1aa-ee90aa7c5e37" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.377288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a30eb853-c461-43e4-b1aa-ee90aa7c5e37" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.377288] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a30eb853-c461-43e4-b1aa-ee90aa7c5e37',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.385850] env[66994]: INFO networking_nsxv3.common.synchronization [None req-0192b139-6c46-4338-bc45-5014a626f80f None None] Enqueued Resource ID: 09503059-93f9-48d7-bb49-16280859d390 with Priority: HIGHEST for action port [ 673.387342] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09503059-93f9-48d7-bb49-16280859d390 with Priority: HIGHEST for action port [ 673.387342] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-09503059-93f9-48d7-bb49-16280859d390 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.387342] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09503059-93f9-48d7-bb49-16280859d390" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.387342] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09503059-93f9-48d7-bb49-16280859d390" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.387342] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09503059-93f9-48d7-bb49-16280859d390" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.388171] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09503059-93f9-48d7-bb49-16280859d390',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.880227] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a30eb853-c461-43e4-b1aa-ee90aa7c5e37 with status ACTIVE [ 673.880227] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.881126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.881126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.881126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.881126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.881126] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.881126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.881901] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.881901] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.881901] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.881901] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.882419] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.882419] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.882500] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.883763] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.883763] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a30eb853-c461-43e4-b1aa-ee90aa7c5e37 is going to be updated. [ 673.885554] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: SUCCESS [ 673.886100] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.893451] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 09503059-93f9-48d7-bb49-16280859d390 [ 673.894025] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.894212] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.894212] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.894447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.895186] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.895186] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:09503059-93f9-48d7-bb49-16280859d390 already deleted. [ 673.895186] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09503059-93f9-48d7-bb49-16280859d390" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.908267] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.908267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.908267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.908267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.908267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.908267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a30eb853-c461-43e4-b1aa-ee90aa7c5e37" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.986659] env[66994]: INFO networking_nsxv3.common.synchronization [req-988b81f7-e15f-4869-a219-95fb0a714617 req-e4573ecb-aac8-4b90-83d4-13f7c8aae198 tempest-ListServerFiltersTestJSON-483871491 tempest-ListServerFiltersTestJSON-483871491-project-member] Enqueued Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_members [ 673.987249] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_members [ 673.987550] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.987668] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.987735] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.987972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.988734] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.988734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.988734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.988734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.988734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.988734] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.130194] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: SUCCESS [ 674.130340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.130510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.130731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.130923] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.131057] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.131129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.131282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.131358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.131448] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.131551] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.132971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.132971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.136344] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.136344] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.136344] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.136344] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.136587] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.136587] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.493422] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.516539] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.516796] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-608" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.516974] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-608" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.517294] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-608" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.517629] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.517897] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.518022] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.518261] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.518409] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.518632] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.518741] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 674.518856] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 674.518965] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 674.519095] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.519205] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 674.519338] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 674.537735] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 674.538058] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 674.538141] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 674.538303] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-608" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.538655] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-65450b60-ae29-4e6e-947b-89c7f68b4c65 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.538830] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-65450b60-ae29-4e6e-947b-89c7f68b4c65" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.538945] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-65450b60-ae29-4e6e-947b-89c7f68b4c65" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.539324] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-65450b60-ae29-4e6e-947b-89c7f68b4c65" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.539460] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65450b60-ae29-4e6e-947b-89c7f68b4c65',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.640426] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.640426] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.640426] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.993669] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.042635] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.043349] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.043349] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.043736] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.043838] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.044048] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 65450b60-ae29-4e6e-947b-89c7f68b4c65 not found, creating... [ 675.044476] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.044930] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.044930] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.047124] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.047124] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.047124] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.047124] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.047124] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.047124] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.047124] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.047124] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 65450b60-ae29-4e6e-947b-89c7f68b4c65 is going to be created. [ 675.076782] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.077037] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.077225] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.077645] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.077878] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.078256] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-65450b60-ae29-4e6e-947b-89c7f68b4c65" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.141526] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.496677] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.496911] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.496911] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.497219] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.497309] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.497415] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb is going to be updated. [ 675.539263] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.539406] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.539528] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.539716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.539879] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.552257] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: IN_PROGRESS for 2s [ 675.644231] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.644395] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.644442] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.644650] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.644754] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.648024] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 is going to be updated. [ 675.677486] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.677694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.677694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.677890] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.678033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.689625] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: IN_PROGRESS for 2s [ 675.885796] env[66994]: INFO networking_nsxv3.common.synchronization [req-988b81f7-e15f-4869-a219-95fb0a714617 req-12a4741b-df21-4fc1-97f9-acc4ccd68046 service nova] Enqueued Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_rules [ 675.885796] env[66994]: INFO networking_nsxv3.common.synchronization [req-988b81f7-e15f-4869-a219-95fb0a714617 req-12a4741b-df21-4fc1-97f9-acc4ccd68046 service nova] Enqueued Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_members [ 675.885796] env[66994]: INFO networking_nsxv3.common.synchronization [req-988b81f7-e15f-4869-a219-95fb0a714617 req-12a4741b-df21-4fc1-97f9-acc4ccd68046 service nova] Enqueued Resource ID: 65450b60-ae29-4e6e-947b-89c7f68b4c65 with Priority: HIGHEST for action port [ 675.886166] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_rules [ 675.886322] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_members [ 675.886423] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65450b60-ae29-4e6e-947b-89c7f68b4c65 with Priority: HIGHEST for action port [ 675.886740] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.886915] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.887021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.887314] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.887448] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.889947] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.890261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.890805] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-65450b60-ae29-4e6e-947b-89c7f68b4c65 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.890805] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65450b60-ae29-4e6e-947b-89c7f68b4c65" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.890805] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65450b60-ae29-4e6e-947b-89c7f68b4c65" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.891306] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65450b60-ae29-4e6e-947b-89c7f68b4c65" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.891306] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65450b60-ae29-4e6e-947b-89c7f68b4c65',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.393660] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.393660] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.394055] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65450b60-ae29-4e6e-947b-89c7f68b4c65 with status ACTIVE [ 676.394098] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.394373] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.394373] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.395572] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.395572] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.395572] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.395572] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.395572] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.395572] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.395814] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.395850] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.396179] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.396265] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.396420] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.396497] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.396584] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65450b60-ae29-4e6e-947b-89c7f68b4c65 is going to be updated. [ 676.427814] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.428062] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.428062] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.428829] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.428829] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.428829] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65450b60-ae29-4e6e-947b-89c7f68b4c65" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.966676] env[66994]: INFO networking_nsxv3.common.synchronization [req-1773de3f-cbe3-415d-96af-baf620b1193f req-df9a38ea-a24a-4142-b02f-a5b1ccca9581 tempest-ServerDiagnosticsTest-3528994 tempest-ServerDiagnosticsTest-3528994-project-member] Enqueued Resource ID: fa1b7e95-7684-4712-b323-6d410e0e0d5b with Priority: HIGHEST for action security_group_members [ 676.967546] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa1b7e95-7684-4712-b323-6d410e0e0d5b with Priority: HIGHEST for action security_group_members [ 676.967852] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa1b7e95-7684-4712-b323-6d410e0e0d5b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.968595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.968595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.968747] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.969586] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.969720] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.969778] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.969984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.970096] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.970433] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa1b7e95-7684-4712-b323-6d410e0e0d5b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.020991] env[66994]: INFO networking_nsxv3.common.synchronization [req-fb37c8c3-73b6-421f-8882-8e3887695093 req-b876a8da-5177-4e63-b92e-3113308be473 tempest-DeleteServersAdminTestJSON-1715216695 tempest-DeleteServersAdminTestJSON-1715216695-project-member] Enqueued Resource ID: 272acbad-bd3f-40f8-972f-dda18f503b74 with Priority: HIGHEST for action security_group_members [ 677.021553] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 272acbad-bd3f-40f8-972f-dda18f503b74 with Priority: HIGHEST for action security_group_members [ 677.021853] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-272acbad-bd3f-40f8-972f-dda18f503b74 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.021970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.022055] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.022276] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.022416] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.022511] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.022571] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.022715] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.022803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.023103] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('272acbad-bd3f-40f8-972f-dda18f503b74',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.473686] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.474015] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.474015] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.474149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.474239] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.474432] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.474526] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.474586] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.474735] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.474822] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.475426] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa1b7e95-7684-4712-b323-6d410e0e0d5b already deleted. [ 677.475620] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.502378] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.503289] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.508032] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.508032] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.508032] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.508032] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.508032] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.508032] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.508032] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.508032] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 677.508032] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 677.508032] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 677.508032] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 677.508032] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 677.508032] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 677.508032] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 677.528263] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.528263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.528263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.528263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.528263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.528263] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.528263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.528263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.528263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.528263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.528263] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 272acbad-bd3f-40f8-972f-dda18f503b74 is going to be updated. [ 677.528891] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 677.529180] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 677.529521] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 677.529905] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.530478] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-c3241698-fc76-4532-a4e1-9fbef5d1e85f taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.530824] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-c3241698-fc76-4532-a4e1-9fbef5d1e85f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.531161] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-c3241698-fc76-4532-a4e1-9fbef5d1e85f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.531575] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-c3241698-fc76-4532-a4e1-9fbef5d1e85f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.531853] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3241698-fc76-4532-a4e1-9fbef5d1e85f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.566924] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.566924] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.567233] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.567233] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.567361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.569497] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: SUCCESS [ 677.569697] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.570704] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.570926] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.571300] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.571457] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.571778] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.572066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.572221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.572331] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.585932] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 272acbad-bd3f-40f8-972f-dda18f503b74 in Status: IN_PROGRESS for 2s [ 677.703139] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: SUCCESS [ 677.703434] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.703609] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.703871] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.704034] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.704154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.704259] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.704396] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.704476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.704567] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.870440] env[66994]: INFO networking_nsxv3.common.synchronization [req-b8ce150f-7ceb-4e83-94d3-a402b8e2ff01 req-45943246-a77a-4653-8977-46443c9ad9f5 tempest-SecurityGroupRulesTestJSON-2081492605 tempest-SecurityGroupRulesTestJSON-2081492605-project-member] Enqueued Resource ID: 68aabf10-d8f0-4d12-aa35-44680f7afb73 with Priority: HIGHEST for action security_group_rules [ 677.871226] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68aabf10-d8f0-4d12-aa35-44680f7afb73 with Priority: HIGHEST for action security_group_rules [ 677.871608] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68aabf10-d8f0-4d12-aa35-44680f7afb73 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.871743] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68aabf10-d8f0-4d12-aa35-44680f7afb73" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.871835] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68aabf10-d8f0-4d12-aa35-44680f7afb73" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.872155] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68aabf10-d8f0-4d12-aa35-44680f7afb73" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.872263] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68aabf10-d8f0-4d12-aa35-44680f7afb73',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.035162] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.035376] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.035524] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.035811] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.035953] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.036118] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port c3241698-fc76-4532-a4e1-9fbef5d1e85f not found, creating... [ 678.036415] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.036568] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.036675] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.036883] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.037014] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.037293] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.037438] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.037546] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.037747] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.037873] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.038010] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: c3241698-fc76-4532-a4e1-9fbef5d1e85f is going to be created. [ 678.058792] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.059015] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.059330] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.059681] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.059951] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.060254] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-c3241698-fc76-4532-a4e1-9fbef5d1e85f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.077107] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.207436] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.400351] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.401173] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.401173] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.401173] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.401173] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.401173] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68aabf10-d8f0-4d12-aa35-44680f7afb73 already deleted. [ 678.401173] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68aabf10-d8f0-4d12-aa35-44680f7afb73" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.579537] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.712669] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.795468] env[66994]: INFO networking_nsxv3.common.synchronization [req-1773de3f-cbe3-415d-96af-baf620b1193f req-6b39f19c-4eab-4abf-ba05-f1ca326fa4e6 service nova] Enqueued Resource ID: fa1b7e95-7684-4712-b323-6d410e0e0d5b with Priority: HIGHEST for action security_group_rules [ 678.795939] env[66994]: INFO networking_nsxv3.common.synchronization [req-1773de3f-cbe3-415d-96af-baf620b1193f req-6b39f19c-4eab-4abf-ba05-f1ca326fa4e6 service nova] Enqueued Resource ID: fa1b7e95-7684-4712-b323-6d410e0e0d5b with Priority: HIGHEST for action security_group_members [ 678.796698] env[66994]: INFO networking_nsxv3.common.synchronization [req-1773de3f-cbe3-415d-96af-baf620b1193f req-6b39f19c-4eab-4abf-ba05-f1ca326fa4e6 service nova] Enqueued Resource ID: c3241698-fc76-4532-a4e1-9fbef5d1e85f with Priority: HIGHEST for action port [ 678.798405] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa1b7e95-7684-4712-b323-6d410e0e0d5b with Priority: HIGHEST for action security_group_rules [ 678.798737] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa1b7e95-7684-4712-b323-6d410e0e0d5b with Priority: HIGHEST for action security_group_members [ 678.798999] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3241698-fc76-4532-a4e1-9fbef5d1e85f with Priority: HIGHEST for action port [ 678.799486] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa1b7e95-7684-4712-b323-6d410e0e0d5b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.799864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.800049] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.800892] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.800892] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa1b7e95-7684-4712-b323-6d410e0e0d5b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.801593] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa1b7e95-7684-4712-b323-6d410e0e0d5b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.801738] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.801738] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.802047] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.802130] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.802215] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.802258] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.802408] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.802502] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.802592] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa1b7e95-7684-4712-b323-6d410e0e0d5b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.803570] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3241698-fc76-4532-a4e1-9fbef5d1e85f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.803725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3241698-fc76-4532-a4e1-9fbef5d1e85f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.803725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3241698-fc76-4532-a4e1-9fbef5d1e85f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.803858] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3241698-fc76-4532-a4e1-9fbef5d1e85f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.803934] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3241698-fc76-4532-a4e1-9fbef5d1e85f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.082366] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.082655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.082655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.082889] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.083012] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.083131] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb is going to be updated. [ 679.115652] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.118786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.118786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.118786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.118786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.127799] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: IN_PROGRESS for 2s [ 679.216586] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.216767] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.216829] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.217128] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.218473] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.218473] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 is going to be updated. [ 679.258226] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.258226] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.261042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.261042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.261042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.276147] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: IN_PROGRESS for 2s [ 679.306434] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa1b7e95-7684-4712-b323-6d410e0e0d5b taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.306434] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.306867] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa1b7e95-7684-4712-b323-6d410e0e0d5b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.307683] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3241698-fc76-4532-a4e1-9fbef5d1e85f with status ACTIVE [ 679.307907] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.309658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.309658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.309658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.309658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.309658] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.309658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.309658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.314278] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.314278] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.314278] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.314278] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.314278] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.314278] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.314278] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.314278] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3241698-fc76-4532-a4e1-9fbef5d1e85f is going to be updated. [ 679.339969] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.341013] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.341013] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.341013] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.341013] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.341013] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3241698-fc76-4532-a4e1-9fbef5d1e85f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.434806] env[66994]: INFO networking_nsxv3.common.synchronization [req-73caf4dc-2cf4-4082-b46c-1bba37dd0a44 req-4b3fdba1-9d89-43da-a7b0-4f25d1a62691 tempest-ListServersNegativeTestJSON-1189554403 tempest-ListServersNegativeTestJSON-1189554403-project-member] Enqueued Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_members [ 679.437833] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_members [ 679.437833] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdf001c-b425-433f-b4c2-dcd41fc81f02 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.437833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.437833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.437833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.437833] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.437833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.437833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.437833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.437833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.437833] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.598270] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 272acbad-bd3f-40f8-972f-dda18f503b74 in Status: SUCCESS [ 679.598703] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 272acbad-bd3f-40f8-972f-dda18f503b74 deletion is rescheduled due to dependency. [ 679.598703] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.690960] env[66994]: INFO networking_nsxv3.common.synchronization [req-2943e3cb-5a00-4475-ac81-cdb06ae9255a req-3a32910d-5f77-4dfc-90da-89710247ec96 tempest-SecurityGroupRulesTestJSON-2081492605 tempest-SecurityGroupRulesTestJSON-2081492605-project-member] Enqueued Resource ID: 68aabf10-d8f0-4d12-aa35-44680f7afb73 with Priority: HIGHEST for action security_group_rules [ 679.693127] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68aabf10-d8f0-4d12-aa35-44680f7afb73 with Priority: HIGHEST for action security_group_rules [ 679.693690] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68aabf10-d8f0-4d12-aa35-44680f7afb73 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.694639] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68aabf10-d8f0-4d12-aa35-44680f7afb73" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.694639] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68aabf10-d8f0-4d12-aa35-44680f7afb73" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.694639] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68aabf10-d8f0-4d12-aa35-44680f7afb73" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.694639] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68aabf10-d8f0-4d12-aa35-44680f7afb73',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.814184] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa1b7e95-7684-4712-b323-6d410e0e0d5b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.864027] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.864027] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-594" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.864027] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-594" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.864027] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-594" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.864027] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.864373] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.864373] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.864589] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.864837] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.865210] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 679.865880] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 679.865880] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 679.865880] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 679.865880] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 679.866109] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 679.866109] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 679.888288] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 679.888288] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 679.888288] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 679.888288] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-594" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.888288] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-3e3a5e8c-9dbd-4865-9372-6f30aa0e180d taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.888288] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-3e3a5e8c-9dbd-4865-9372-6f30aa0e180d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.888288] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-3e3a5e8c-9dbd-4865-9372-6f30aa0e180d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.888288] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-3e3a5e8c-9dbd-4865-9372-6f30aa0e180d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.888288] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e3a5e8c-9dbd-4865-9372-6f30aa0e180d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.940148] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.940148] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.940953] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.940953] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.940953] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.940953] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.940953] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.941340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.941340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.941340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.941500] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 already deleted. [ 679.941500] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.215965] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.215965] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.215965] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.215965] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.216183] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.216183] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68aabf10-d8f0-4d12-aa35-44680f7afb73 already deleted. [ 680.216301] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68aabf10-d8f0-4d12-aa35-44680f7afb73" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.316820] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.316996] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.317080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.317313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.317402] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.317526] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa1b7e95-7684-4712-b323-6d410e0e0d5b is going to be created. [ 680.350501] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.350710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.350828] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.351088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.351297] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.364700] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa1b7e95-7684-4712-b323-6d410e0e0d5b in Status: UNINITIALIZED for 2s [ 680.391943] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.392190] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.392582] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.392582] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.392681] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.392830] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 3e3a5e8c-9dbd-4865-9372-6f30aa0e180d not found, creating... [ 680.393097] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.393321] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.393461] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.393676] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.393805] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.394275] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.394275] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.394439] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.394552] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.394676] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.394805] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 3e3a5e8c-9dbd-4865-9372-6f30aa0e180d is going to be created. [ 680.417507] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.417778] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.417942] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.418259] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.418483] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.418951] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-3e3a5e8c-9dbd-4865-9372-6f30aa0e180d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.140830] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: SUCCESS [ 681.140830] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.140830] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.141478] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.141478] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.141478] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.141478] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.141664] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.141764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.141909] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.142057] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.170147] env[66994]: INFO networking_nsxv3.common.synchronization [req-73caf4dc-2cf4-4082-b46c-1bba37dd0a44 req-acd0c23a-071a-4e63-8b27-1687efad2245 service nova] Enqueued Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_rules [ 681.170147] env[66994]: INFO networking_nsxv3.common.synchronization [req-73caf4dc-2cf4-4082-b46c-1bba37dd0a44 req-acd0c23a-071a-4e63-8b27-1687efad2245 service nova] Enqueued Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_members [ 681.170147] env[66994]: INFO networking_nsxv3.common.synchronization [req-73caf4dc-2cf4-4082-b46c-1bba37dd0a44 req-acd0c23a-071a-4e63-8b27-1687efad2245 service nova] Enqueued Resource ID: 3e3a5e8c-9dbd-4865-9372-6f30aa0e180d with Priority: HIGHEST for action port [ 681.170147] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_rules [ 681.170147] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_members [ 681.170147] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3a5e8c-9dbd-4865-9372-6f30aa0e180d with Priority: HIGHEST for action port [ 681.170147] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fdf001c-b425-433f-b4c2-dcd41fc81f02 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.170147] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.170147] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.171157] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.172211] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.173347] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdf001c-b425-433f-b4c2-dcd41fc81f02 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.173629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.173796] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.174132] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.175023] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.175023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.175023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.175023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.175023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.175023] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.176062] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e3a5e8c-9dbd-4865-9372-6f30aa0e180d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.176316] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e3a5e8c-9dbd-4865-9372-6f30aa0e180d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.176497] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e3a5e8c-9dbd-4865-9372-6f30aa0e180d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.176732] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e3a5e8c-9dbd-4865-9372-6f30aa0e180d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.178396] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e3a5e8c-9dbd-4865-9372-6f30aa0e180d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.287234] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: SUCCESS [ 681.287234] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.287234] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.287567] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.287567] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.287750] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.287750] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.287890] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.287955] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.288063] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.288216] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.288324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.288395] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.288565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.288746] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.288859] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.288927] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.289097] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.289227] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.289369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.289522] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.645050] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.645179] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.645179] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.646041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.646041] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.646041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.646041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.646041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.646041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.646041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.646413] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.646413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.646413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.646529] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.646603] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.646703] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.646767] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.646892] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.646963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.647057] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.647135] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.681032] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdf001c-b425-433f-b4c2-dcd41fc81f02 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.681032] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.681032] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.681032] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e3a5e8c-9dbd-4865-9372-6f30aa0e180d with status ACTIVE [ 681.681032] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.681032] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.681032] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.681032] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.681032] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.681032] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.681032] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.681032] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.681032] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.681032] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.681812] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.684407] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.684407] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.684407] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.684407] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.684407] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e3a5e8c-9dbd-4865-9372-6f30aa0e180d is going to be updated. [ 681.711368] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.711531] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.711657] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.712045] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.712045] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.712163] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e3a5e8c-9dbd-4865-9372-6f30aa0e180d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.792070] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d46fc8e7-8fb5-4007-bec6-48eb732825b5: rpc.has_security_group_logging(os_id): False [ 681.814664] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.814822] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.814880] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.815109] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.815201] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.815431] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.815535] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.815621] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.815885] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.816192] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.816543] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.816760] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.816886] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.817375] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.817598] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.817961] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.818163] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.818286] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.818554] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.818703] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.819164] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 is going to be created. [ 681.832142] env[66994]: INFO networking_nsxv3.common.synchronization [req-c5815fa9-85d1-4f8b-8084-a3433d07815a req-4895d969-51ad-48da-a2db-ecfe04dcaa81 tempest-FloatingIPsAssociationNegativeTestJSON-2031438366 tempest-FloatingIPsAssociationNegativeTestJSON-2031438366-project-member] Enqueued Resource ID: 3ea9c700-dac6-4282-90b7-8b85af493263 with Priority: HIGHEST for action security_group_members [ 681.832661] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ea9c700-dac6-4282-90b7-8b85af493263 with Priority: HIGHEST for action security_group_members [ 681.833636] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ea9c700-dac6-4282-90b7-8b85af493263 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.833636] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.833636] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.833636] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.833899] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.833899] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.833899] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.834079] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.834127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.834231] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ea9c700-dac6-4282-90b7-8b85af493263',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.908854] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.908854] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.908854] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.909146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.909350] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.922576] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: IN_PROGRESS for 2s [ 682.149368] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ca0171b-7165-4d45-aa70-8fe66df074eb: rpc.has_security_group_logging(os_id): False [ 682.169343] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.169343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.169343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.169343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.169343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.169666] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.169666] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.169666] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.169991] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.169991] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.170162] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.170162] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.170327] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.170365] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.170423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.170582] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.170691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.170734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.170846] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.170910] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.170988] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb is going to be updated. [ 682.189395] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.264938] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.265182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.265283] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.265632] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.265806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.286301] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: IN_PROGRESS for 2s [ 682.339891] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.339891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.339891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.339891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.339891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.339891] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.339891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.339891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.339891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.339891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.339891] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ea9c700-dac6-4282-90b7-8b85af493263 is going to be updated. [ 682.382437] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa1b7e95-7684-4712-b323-6d410e0e0d5b in Status: SUCCESS [ 682.382743] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.386247] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.386247] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.386247] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.386490] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.386490] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.389270] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.389496] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.389986] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.389986] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.389986] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.390202] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.390202] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.390202] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.390323] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa1b7e95-7684-4712-b323-6d410e0e0d5b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.407862] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ea9c700-dac6-4282-90b7-8b85af493263 in Status: IN_PROGRESS for 2s [ 682.692390] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.692598] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.692598] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.692882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.692882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.693031] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 is going to be created. [ 682.732208] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.732426] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.732426] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.732635] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.732794] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.747995] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 in Status: UNINITIALIZED for 2s [ 682.868327] env[66994]: INFO networking_nsxv3.common.synchronization [req-0c507f21-1432-4991-a984-358a940e564b req-b2e1f65e-57a8-4a23-a330-c1662dc59d14 tempest-SecurityGroupRulesTestJSON-2081492605 tempest-SecurityGroupRulesTestJSON-2081492605-project-member] Enqueued Resource ID: 68aabf10-d8f0-4d12-aa35-44680f7afb73 with Priority: HIGHEST for action security_group_rules [ 682.868785] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68aabf10-d8f0-4d12-aa35-44680f7afb73 with Priority: HIGHEST for action security_group_rules [ 682.869263] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68aabf10-d8f0-4d12-aa35-44680f7afb73 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.869391] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68aabf10-d8f0-4d12-aa35-44680f7afb73" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.869437] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68aabf10-d8f0-4d12-aa35-44680f7afb73" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.869630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68aabf10-d8f0-4d12-aa35-44680f7afb73" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.869713] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68aabf10-d8f0-4d12-aa35-44680f7afb73',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.893435] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa1b7e95-7684-4712-b323-6d410e0e0d5b taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.893435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.893693] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.893693] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.893964] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.894077] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.894136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.894333] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.894429] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.894509] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.894670] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa1b7e95-7684-4712-b323-6d410e0e0d5b taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.894781] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.894837] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.894994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.895150] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.895218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.895218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.895369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.895426] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.895467] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.895605] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa1b7e95-7684-4712-b323-6d410e0e0d5b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.395928] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.396283] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.396283] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.396384] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.396479] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.396579] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68aabf10-d8f0-4d12-aa35-44680f7afb73 already deleted. [ 683.396660] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68aabf10-d8f0-4d12-aa35-44680f7afb73" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.398079] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa1b7e95-7684-4712-b323-6d410e0e0d5b: rpc.has_security_group_logging(os_id): False [ 683.417801] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.417970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.418022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.418243] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.418333] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.418539] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.418659] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.418695] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.418834] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.418908] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.419089] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.419181] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.419241] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.419378] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.419451] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.419631] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.419722] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.419781] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.419916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.419988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.422267] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa1b7e95-7684-4712-b323-6d410e0e0d5b is going to be created. [ 683.486311] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.486569] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.486620] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.486856] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.487755] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.502953] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa1b7e95-7684-4712-b323-6d410e0e0d5b in Status: IN_PROGRESS for 2s [ 683.925288] env[66994]: INFO networking_nsxv3.common.synchronization [req-73caf4dc-2cf4-4082-b46c-1bba37dd0a44 req-fc731d7c-ae73-49d8-9a7d-b4dc97909d29 tempest-ListServersNegativeTestJSON-1189554403 tempest-ListServersNegativeTestJSON-1189554403-project-member] Enqueued Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_members [ 683.926045] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_members [ 683.928023] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdf001c-b425-433f-b4c2-dcd41fc81f02 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.928023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.945734] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: SUCCESS [ 683.945734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.945734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.945734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.945734] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.319937] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: SUCCESS [ 684.323886] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.364043] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.364043] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-594" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.364043] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-594" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.364043] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-594" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.364043] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.364043] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.364043] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.364043] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.364654] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.364654] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.364741] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 684.364857] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 684.365012] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 684.365174] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.365329] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 684.365545] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 684.391849] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 684.391952] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 684.392168] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 684.392763] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-594" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.392763] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-10c842b2-876d-42a8-aac3-0a7d8bda7bcb taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.392962] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-10c842b2-876d-42a8-aac3-0a7d8bda7bcb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.392962] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-10c842b2-876d-42a8-aac3-0a7d8bda7bcb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.393257] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-10c842b2-876d-42a8-aac3-0a7d8bda7bcb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.393399] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10c842b2-876d-42a8-aac3-0a7d8bda7bcb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.419218] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ea9c700-dac6-4282-90b7-8b85af493263 in Status: SUCCESS [ 684.419461] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ea9c700-dac6-4282-90b7-8b85af493263 deletion is rescheduled due to dependency. [ 684.419516] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.447814] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.447951] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.448031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.448253] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.448416] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.448552] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.448592] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.448715] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.448795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.448875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.448966] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.758932] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 in Status: SUCCESS [ 684.759160] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.759326] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.759585] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.759749] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.759874] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.759936] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.760092] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.760163] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.760249] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.760349] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.761187] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.761367] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.761525] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.761629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.761704] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.761852] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.761935] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.762016] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.895654] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.895903] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.896023] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.896329] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.896495] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.896675] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 10c842b2-876d-42a8-aac3-0a7d8bda7bcb not found, creating... [ 684.896991] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.897180] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.897294] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.897549] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.897696] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.897998] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.898165] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.898271] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.898517] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.898665] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.898801] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 10c842b2-876d-42a8-aac3-0a7d8bda7bcb is going to be created. [ 684.919678] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.919982] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.920129] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.920386] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.920692] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.920913] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-10c842b2-876d-42a8-aac3-0a7d8bda7bcb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.952385] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.952385] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.952385] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.952598] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.952784] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.952907] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.952960] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.953107] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.953171] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.953351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.953548] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.953647] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.953733] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.953859] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.953987] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.954109] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.954155] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.954764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.954764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.954764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.954764] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.263869] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdf001c-b425-433f-b4c2-dcd41fc81f02 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.264108] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.264400] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.457973] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d46fc8e7-8fb5-4007-bec6-48eb732825b5: rpc.has_security_group_logging(os_id): False [ 685.480454] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.480454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.480454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.480785] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.480785] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.481053] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.481204] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.481370] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.481505] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.481693] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.482012] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.482169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.482258] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.482692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.482863] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.483058] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.483234] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.483399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.483468] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.483576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.483692] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 is going to be updated. [ 685.508339] env[66994]: INFO networking_nsxv3.common.synchronization [req-6799bec3-a472-4f4f-ba4e-2fa61ec6c6ce req-fef21c0d-8a1d-4a05-a891-681dd665eb45 tempest-FloatingIPsAssociationTestJSON-1494503625 tempest-FloatingIPsAssociationTestJSON-1494503625-project-member] Enqueued Resource ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea with Priority: HIGHEST for action security_group_members [ 685.509203] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea with Priority: HIGHEST for action security_group_members [ 685.509614] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.509750] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.509810] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.510022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.510184] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.510276] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.510366] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.510497] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.510643] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.510707] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605734aa-d0fb-486b-9d2a-22c70d9dd0ea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.516688] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa1b7e95-7684-4712-b323-6d410e0e0d5b in Status: SUCCESS [ 685.517360] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.561293] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.561293] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.561293] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.561667] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.561737] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.575571] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: IN_PROGRESS for 2s [ 685.663705] env[66994]: INFO networking_nsxv3.common.synchronization [req-73caf4dc-2cf4-4082-b46c-1bba37dd0a44 req-940cb4bc-7c24-4362-96da-10b51354ec59 service nova] Enqueued Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_rules [ 685.663895] env[66994]: INFO networking_nsxv3.common.synchronization [req-73caf4dc-2cf4-4082-b46c-1bba37dd0a44 req-940cb4bc-7c24-4362-96da-10b51354ec59 service nova] Enqueued Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_members [ 685.664043] env[66994]: INFO networking_nsxv3.common.synchronization [req-73caf4dc-2cf4-4082-b46c-1bba37dd0a44 req-940cb4bc-7c24-4362-96da-10b51354ec59 service nova] Enqueued Resource ID: 10c842b2-876d-42a8-aac3-0a7d8bda7bcb with Priority: HIGHEST for action port [ 685.664617] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_rules [ 685.664765] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_members [ 685.664862] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10c842b2-876d-42a8-aac3-0a7d8bda7bcb with Priority: HIGHEST for action port [ 685.665651] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fdf001c-b425-433f-b4c2-dcd41fc81f02 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.665738] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.666060] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdf001c-b425-433f-b4c2-dcd41fc81f02 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.666344] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.666458] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-10c842b2-876d-42a8-aac3-0a7d8bda7bcb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.666566] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10c842b2-876d-42a8-aac3-0a7d8bda7bcb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.666628] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10c842b2-876d-42a8-aac3-0a7d8bda7bcb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.670027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10c842b2-876d-42a8-aac3-0a7d8bda7bcb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.670027] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10c842b2-876d-42a8-aac3-0a7d8bda7bcb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.769491] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.013323] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605734aa-d0fb-486b-9d2a-22c70d9dd0ea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.171343] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10c842b2-876d-42a8-aac3-0a7d8bda7bcb with status ACTIVE [ 686.171614] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.171753] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.171815] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.172297] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.172297] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.172643] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.173038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.173152] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.173553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.174286] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.174286] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.175221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.175923] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.176320] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.176320] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.176922] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10c842b2-876d-42a8-aac3-0a7d8bda7bcb is going to be updated. [ 686.200677] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.200927] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.201018] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.201322] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.201484] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.201730] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10c842b2-876d-42a8-aac3-0a7d8bda7bcb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.271682] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.271833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.271902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.272140] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.272243] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.272339] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 is going to be updated. [ 686.304999] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.305451] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.305561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.305861] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.306523] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.330630] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 in Status: IN_PROGRESS for 2s [ 686.516054] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605734aa-d0fb-486b-9d2a-22c70d9dd0ea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.589702] env[66994]: INFO networking_nsxv3.common.synchronization [req-73caf4dc-2cf4-4082-b46c-1bba37dd0a44 req-a475234c-8d4b-42ee-8014-5e0b92e712eb tempest-ListServersNegativeTestJSON-1189554403 tempest-ListServersNegativeTestJSON-1189554403-project-member] Enqueued Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_members [ 686.590262] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_members [ 686.591550] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdf001c-b425-433f-b4c2-dcd41fc81f02 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.591656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.941300] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.941654] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-594" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.941896] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-594" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.942742] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-594" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.942874] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.943208] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.943348] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.943690] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.944146] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.944399] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.944596] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.944778] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.944945] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.945163] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.945404] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.945679] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.968185] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.968185] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 686.968185] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.968446] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-594" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.968597] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-dfe5f6aa-f6bc-4ef6-855d-fcb9ee3b7bc9 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.968908] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-dfe5f6aa-f6bc-4ef6-855d-fcb9ee3b7bc9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.968982] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-dfe5f6aa-f6bc-4ef6-855d-fcb9ee3b7bc9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.969322] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-dfe5f6aa-f6bc-4ef6-855d-fcb9ee3b7bc9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.969492] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfe5f6aa-f6bc-4ef6-855d-fcb9ee3b7bc9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.018298] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.018505] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.019269] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.019269] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.019269] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.019269] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea is going to be updated. [ 687.053820] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.056618] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.056618] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.056618] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.056618] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.066365] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea in Status: IN_PROGRESS for 2s [ 687.472030] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.472254] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.472402] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.472684] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.473251] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.473251] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port dfe5f6aa-f6bc-4ef6-855d-fcb9ee3b7bc9 not found, creating... [ 687.474680] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.474875] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.475173] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.475376] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.475464] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.475721] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.475875] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.476045] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.476215] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.476343] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.476480] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: dfe5f6aa-f6bc-4ef6-855d-fcb9ee3b7bc9 is going to be created. [ 687.496934] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.497162] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.497478] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.497803] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.498051] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.498284] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-dfe5f6aa-f6bc-4ef6-855d-fcb9ee3b7bc9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.592103] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: SUCCESS [ 687.592647] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.215155] env[66994]: INFO networking_nsxv3.common.synchronization [req-73caf4dc-2cf4-4082-b46c-1bba37dd0a44 req-b4ae617a-fbc0-4111-be00-6fa854aad684 service nova] Enqueued Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_rules [ 688.215384] env[66994]: INFO networking_nsxv3.common.synchronization [req-73caf4dc-2cf4-4082-b46c-1bba37dd0a44 req-b4ae617a-fbc0-4111-be00-6fa854aad684 service nova] Enqueued Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_members [ 688.215561] env[66994]: INFO networking_nsxv3.common.synchronization [req-73caf4dc-2cf4-4082-b46c-1bba37dd0a44 req-b4ae617a-fbc0-4111-be00-6fa854aad684 service nova] Enqueued Resource ID: dfe5f6aa-f6bc-4ef6-855d-fcb9ee3b7bc9 with Priority: HIGHEST for action port [ 688.216201] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_rules [ 688.216368] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_members [ 688.216470] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfe5f6aa-f6bc-4ef6-855d-fcb9ee3b7bc9 with Priority: HIGHEST for action port [ 688.217144] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fdf001c-b425-433f-b4c2-dcd41fc81f02 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.217237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.217451] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdf001c-b425-433f-b4c2-dcd41fc81f02 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.217554] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.217763] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfe5f6aa-f6bc-4ef6-855d-fcb9ee3b7bc9 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.217867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfe5f6aa-f6bc-4ef6-855d-fcb9ee3b7bc9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.217929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfe5f6aa-f6bc-4ef6-855d-fcb9ee3b7bc9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.218149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfe5f6aa-f6bc-4ef6-855d-fcb9ee3b7bc9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.218232] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfe5f6aa-f6bc-4ef6-855d-fcb9ee3b7bc9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.341721] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 in Status: SUCCESS [ 688.341721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.341721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.342017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.342249] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.342387] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.342454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.342627] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.342725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.342814] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.343119] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdf001c-b425-433f-b4c2-dcd41fc81f02 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.343206] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.343270] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.343483] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.343647] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.343785] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.343851] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.344034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.344143] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.344260] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.344405] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.345294] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.345458] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.345605] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.345725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.345793] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.345946] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.346104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.346192] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.722352] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dfe5f6aa-f6bc-4ef6-855d-fcb9ee3b7bc9 with status ACTIVE [ 688.722352] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.722352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.722352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.722352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.722352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.722352] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.722352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.722352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.722352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.722352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.722352] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.722352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.723010] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.723010] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.723010] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.723010] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dfe5f6aa-f6bc-4ef6-855d-fcb9ee3b7bc9 is going to be updated. [ 688.750112] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.750484] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.750484] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.750681] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.750865] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.751095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfe5f6aa-f6bc-4ef6-855d-fcb9ee3b7bc9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.849755] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fdf001c-b425-433f-b4c2-dcd41fc81f02: rpc.has_security_group_logging(os_id): False [ 688.853455] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.878896] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.879067] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.879129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.879359] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.879450] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.879649] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.879772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.879809] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.879956] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.880051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.880249] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.880347] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.880410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.880551] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.880627] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.880809] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.880900] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.880961] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.881114] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.881234] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.881360] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 is going to be created. [ 688.969914] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.970076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.970137] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.970782] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.970782] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.987128] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 in Status: IN_PROGRESS for 2s [ 689.089968] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea in Status: SUCCESS [ 689.090287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.355618] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.707342] env[66994]: INFO networking_nsxv3.common.synchronization [req-26dbff0c-83cb-49d0-b25b-edb0e68be510 req-236af644-b33f-4ad7-9121-6c44354d7dda tempest-ServerActionsV293TestJSON-570448108 tempest-ServerActionsV293TestJSON-570448108-project-member] Enqueued Resource ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b with Priority: HIGHEST for action security_group_members [ 689.707876] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b with Priority: HIGHEST for action security_group_members [ 689.708210] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.708515] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.708515] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.708671] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.708831] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.708942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.709023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.709177] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.709276] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.709413] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4672e8d-a5ca-46f8-8d7b-adf4da6e472b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.857578] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.858062] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.858062] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.858118] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.858200] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.858306] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 is going to be updated. [ 689.889277] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.889447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.889491] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.889698] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.889845] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.900043] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 in Status: IN_PROGRESS for 2s [ 690.217222] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.217222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.217222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.217222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.217222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.217222] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.217222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.217222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.217222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.217222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.217222] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b already deleted. [ 690.217222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.415273] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-370 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.415479] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-370" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.415600] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-370" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.415945] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-370" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.416328] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.416541] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.416712] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.416988] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.417203] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.417502] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 690.417650] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 690.417804] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 690.417951] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 690.418113] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 690.418265] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 690.418428] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 690.440356] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 690.440356] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 690.440420] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 690.440560] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-370" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.440894] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-8e86c2f6-59ef-41f3-b26a-94b80cfb3eaa taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.441069] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-8e86c2f6-59ef-41f3-b26a-94b80cfb3eaa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.441182] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-8e86c2f6-59ef-41f3-b26a-94b80cfb3eaa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.441521] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-8e86c2f6-59ef-41f3-b26a-94b80cfb3eaa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.441651] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e86c2f6-59ef-41f3-b26a-94b80cfb3eaa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.944624] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.944911] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.945133] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.945533] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.945800] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.945977] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 8e86c2f6-59ef-41f3-b26a-94b80cfb3eaa not found, creating... [ 690.946363] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.946541] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.946662] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.947028] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.947223] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.947616] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.947838] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.947973] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.948212] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.948390] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.948571] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 8e86c2f6-59ef-41f3-b26a-94b80cfb3eaa is going to be created. [ 690.974616] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.974835] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.974971] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.975386] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.975792] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.976090] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-8e86c2f6-59ef-41f3-b26a-94b80cfb3eaa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.002403] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 in Status: SUCCESS [ 691.002637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.002845] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.003131] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.003226] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.249140] env[66994]: INFO networking_nsxv3.common.synchronization [None req-be543a6e-ad17-4be7-90b2-55e397b3fb2e None None] Enqueued Resource ID: 409abd4e-4a18-433e-9caa-bbdbb2d48aa2 with Priority: HIGHEST for action port [ 691.249763] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 409abd4e-4a18-433e-9caa-bbdbb2d48aa2 with Priority: HIGHEST for action port [ 691.250108] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-409abd4e-4a18-433e-9caa-bbdbb2d48aa2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.250228] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-409abd4e-4a18-433e-9caa-bbdbb2d48aa2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.250295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-409abd4e-4a18-433e-9caa-bbdbb2d48aa2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.250644] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-409abd4e-4a18-433e-9caa-bbdbb2d48aa2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.250720] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('409abd4e-4a18-433e-9caa-bbdbb2d48aa2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.506191] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdf001c-b425-433f-b4c2-dcd41fc81f02 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.508453] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.694921] env[66994]: INFO networking_nsxv3.common.synchronization [req-26dbff0c-83cb-49d0-b25b-edb0e68be510 req-3e87ec9e-939d-4544-a60a-07047835cbc8 service nova] Enqueued Resource ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b with Priority: HIGHEST for action security_group_rules [ 691.695176] env[66994]: INFO networking_nsxv3.common.synchronization [req-26dbff0c-83cb-49d0-b25b-edb0e68be510 req-3e87ec9e-939d-4544-a60a-07047835cbc8 service nova] Enqueued Resource ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b with Priority: HIGHEST for action security_group_members [ 691.695706] env[66994]: INFO networking_nsxv3.common.synchronization [req-26dbff0c-83cb-49d0-b25b-edb0e68be510 req-3e87ec9e-939d-4544-a60a-07047835cbc8 service nova] Enqueued Resource ID: 8e86c2f6-59ef-41f3-b26a-94b80cfb3eaa with Priority: HIGHEST for action port [ 691.696128] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b with Priority: HIGHEST for action security_group_rules [ 691.696374] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b with Priority: HIGHEST for action security_group_members [ 691.696543] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e86c2f6-59ef-41f3-b26a-94b80cfb3eaa with Priority: HIGHEST for action port [ 691.696927] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.697193] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.697306] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.697602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.698956] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4672e8d-a5ca-46f8-8d7b-adf4da6e472b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.700034] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.700034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.700148] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.700292] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.700444] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.700540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.700835] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.700835] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.700835] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.700908] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4672e8d-a5ca-46f8-8d7b-adf4da6e472b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.701706] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e86c2f6-59ef-41f3-b26a-94b80cfb3eaa taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.701824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e86c2f6-59ef-41f3-b26a-94b80cfb3eaa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.701872] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e86c2f6-59ef-41f3-b26a-94b80cfb3eaa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.706314] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e86c2f6-59ef-41f3-b26a-94b80cfb3eaa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.706314] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e86c2f6-59ef-41f3-b26a-94b80cfb3eaa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.752470] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 409abd4e-4a18-433e-9caa-bbdbb2d48aa2 [ 691.752793] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.752921] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.752987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.753215] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.753303] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.753427] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:409abd4e-4a18-433e-9caa-bbdbb2d48aa2 already deleted. [ 691.753511] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-409abd4e-4a18-433e-9caa-bbdbb2d48aa2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.910874] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 in Status: SUCCESS [ 691.910874] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.910874] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.911212] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.911309] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.911555] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.911555] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.911657] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.911742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.911838] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.064362] env[66994]: INFO networking_nsxv3.common.synchronization [req-0eb29c20-7d65-491b-b829-c7a616d6393f req-62ca99e8-3db5-45c7-8356-ac244778e54d tempest-ImagesOneServerTestJSON-291128885 tempest-ImagesOneServerTestJSON-291128885-project-member] Enqueued Resource ID: 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a with Priority: HIGHEST for action security_group_members [ 692.064362] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a with Priority: HIGHEST for action security_group_members [ 692.064832] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.064832] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.064918] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.065739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.065739] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.065739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.065739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.065739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.065947] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.066053] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.203473] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4672e8d-a5ca-46f8-8d7b-adf4da6e472b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.205878] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.205878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.205878] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e86c2f6-59ef-41f3-b26a-94b80cfb3eaa with status ACTIVE [ 692.205878] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.205878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.205878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.205878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.205878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.210955] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.211200] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.211278] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.211508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.212052] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.212052] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.212052] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.212052] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.212245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.212245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.212293] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e86c2f6-59ef-41f3-b26a-94b80cfb3eaa is going to be updated. [ 692.242489] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.242489] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.242489] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.242489] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.242489] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.242489] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e86c2f6-59ef-41f3-b26a-94b80cfb3eaa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.414554] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.540433] env[66994]: INFO networking_nsxv3.common.synchronization [req-2df7b3db-9373-4147-8382-9ce4d21d42be req-83e0030c-c3d8-4c39-9232-86dfc47e1c06 tempest-ImagesOneServerNegativeTestJSON-1432587522 tempest-ImagesOneServerNegativeTestJSON-1432587522-project-member] Enqueued Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_members [ 692.541053] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_members [ 692.541401] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-11c0b684-9731-4046-89ad-f4bf7b2168d4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.541536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.541627] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.542320] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.542320] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.542320] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.542320] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.542320] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.542320] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.542677] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.569083] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.569512] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.569612] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.569964] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.570044] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.570348] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.570496] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.571535] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.571535] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.571535] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.571535] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a is going to be updated. [ 692.606398] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.606706] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.606790] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.606958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.607120] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.618950] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a in Status: IN_PROGRESS for 2s [ 692.706468] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4672e8d-a5ca-46f8-8d7b-adf4da6e472b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.766820] env[66994]: INFO networking_nsxv3.common.synchronization [req-0fa66ea7-4271-4bac-aec4-d94e08fba638 req-e8a6f3ba-59c8-40bc-9b5f-e560d2f7ce4e tempest-InstanceActionsTestJSON-365549542 tempest-InstanceActionsTestJSON-365549542-project-member] Enqueued Resource ID: cda947aa-81ac-4826-ab42-0806fdd02361 with Priority: HIGHEST for action security_group_members [ 692.767431] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cda947aa-81ac-4826-ab42-0806fdd02361 with Priority: HIGHEST for action security_group_members [ 692.771230] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-cda947aa-81ac-4826-ab42-0806fdd02361 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.771230] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.774197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.774544] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.774744] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.774863] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.774927] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.775103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.775188] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.775279] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cda947aa-81ac-4826-ab42-0806fdd02361',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.918380] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.044829] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.044993] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.045056] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.045290] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.045387] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.045585] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.046190] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.046606] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.046646] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.046754] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.046821] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 is going to be updated. [ 693.083562] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.083925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.083925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.084189] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.084649] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.096467] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 in Status: IN_PROGRESS for 2s [ 693.173672] env[66994]: INFO networking_nsxv3.common.synchronization [None req-7751e7ad-1a0e-4cec-91d9-aa50e69131d9 None None] Enqueued Resource ID: 52664974-4e32-4b2b-985c-af91c52d9b39 with Priority: HIGHEST for action port [ 693.173843] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52664974-4e32-4b2b-985c-af91c52d9b39 with Priority: HIGHEST for action port [ 693.174901] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-52664974-4e32-4b2b-985c-af91c52d9b39 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.175418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52664974-4e32-4b2b-985c-af91c52d9b39" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.175418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52664974-4e32-4b2b-985c-af91c52d9b39" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.175603] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52664974-4e32-4b2b-985c-af91c52d9b39" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.175909] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52664974-4e32-4b2b-985c-af91c52d9b39',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.211937] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.212159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.212159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.212813] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.212813] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.212813] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b is going to be created. [ 693.255058] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.255058] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.255058] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.255058] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.255058] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.269182] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b in Status: UNINITIALIZED for 2s [ 693.277955] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.278148] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.278196] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.278453] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.279495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.279495] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.279495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.279495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.279495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.279495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.279495] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cda947aa-81ac-4826-ab42-0806fdd02361 already deleted. [ 693.279495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.298032] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-60 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.298228] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-60" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.298399] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-60" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.298858] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-60" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.299131] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.299369] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.299516] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.300149] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.300149] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.300292] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 693.300949] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.300949] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.300949] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.300949] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 693.300949] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.301173] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.360381] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.360784] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.059 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 693.360865] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.361065] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-60" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.361388] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-c07d505c-f980-415b-83f4-7e47978f1133 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.361560] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-c07d505c-f980-415b-83f4-7e47978f1133" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.361674] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-c07d505c-f980-415b-83f4-7e47978f1133" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.361990] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-c07d505c-f980-415b-83f4-7e47978f1133" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.362156] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c07d505c-f980-415b-83f4-7e47978f1133',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.420884] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.421062] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.421152] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.421442] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.421544] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.421648] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 is going to be updated. [ 693.457250] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.457418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.457493] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.457712] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.457866] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.467367] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 in Status: IN_PROGRESS for 2s [ 693.678672] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 52664974-4e32-4b2b-985c-af91c52d9b39 [ 693.681048] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.681048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.681048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.681048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.681048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.681048] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:52664974-4e32-4b2b-985c-af91c52d9b39 already deleted. [ 693.681048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52664974-4e32-4b2b-985c-af91c52d9b39" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.865436] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.865436] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.865632] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.865831] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.865977] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.866144] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port c07d505c-f980-415b-83f4-7e47978f1133 not found, creating... [ 693.866425] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.866574] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.866745] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.867076] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.867226] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.867504] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.867650] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.867763] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.867961] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.868098] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.868233] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: c07d505c-f980-415b-83f4-7e47978f1133 is going to be created. [ 693.889610] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.889996] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.889996] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.890326] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.890627] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.890971] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-c07d505c-f980-415b-83f4-7e47978f1133" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.588462] env[66994]: INFO networking_nsxv3.common.synchronization [req-0fa66ea7-4271-4bac-aec4-d94e08fba638 req-bc25cf3e-0747-4b6f-9d43-2533912dbaae service nova] Enqueued Resource ID: cda947aa-81ac-4826-ab42-0806fdd02361 with Priority: HIGHEST for action security_group_rules [ 694.588718] env[66994]: INFO networking_nsxv3.common.synchronization [req-0fa66ea7-4271-4bac-aec4-d94e08fba638 req-bc25cf3e-0747-4b6f-9d43-2533912dbaae service nova] Enqueued Resource ID: cda947aa-81ac-4826-ab42-0806fdd02361 with Priority: HIGHEST for action security_group_members [ 694.588752] env[66994]: INFO networking_nsxv3.common.synchronization [req-0fa66ea7-4271-4bac-aec4-d94e08fba638 req-bc25cf3e-0747-4b6f-9d43-2533912dbaae service nova] Enqueued Resource ID: c07d505c-f980-415b-83f4-7e47978f1133 with Priority: HIGHEST for action port [ 694.589313] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cda947aa-81ac-4826-ab42-0806fdd02361 with Priority: HIGHEST for action security_group_rules [ 694.589442] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cda947aa-81ac-4826-ab42-0806fdd02361 with Priority: HIGHEST for action security_group_members [ 694.589538] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c07d505c-f980-415b-83f4-7e47978f1133 with Priority: HIGHEST for action port [ 694.589804] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cda947aa-81ac-4826-ab42-0806fdd02361 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.589923] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.589986] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.590249] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.590331] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cda947aa-81ac-4826-ab42-0806fdd02361',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.592910] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-cda947aa-81ac-4826-ab42-0806fdd02361 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.593040] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.593110] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.593292] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.593480] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.593595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.593625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.593772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.593854] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.593960] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cda947aa-81ac-4826-ab42-0806fdd02361',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.594767] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-c07d505c-f980-415b-83f4-7e47978f1133 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.594879] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c07d505c-f980-415b-83f4-7e47978f1133" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.594941] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c07d505c-f980-415b-83f4-7e47978f1133" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.595106] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c07d505c-f980-415b-83f4-7e47978f1133" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.595185] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c07d505c-f980-415b-83f4-7e47978f1133',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.633072] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a in Status: SUCCESS [ 694.633265] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a deletion is rescheduled due to dependency. [ 694.633418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.097582] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-cda947aa-81ac-4826-ab42-0806fdd02361 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.097790] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.099720] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cda947aa-81ac-4826-ab42-0806fdd02361',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.100722] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c07d505c-f980-415b-83f4-7e47978f1133 with status ACTIVE [ 695.100967] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.101125] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.101195] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.101465] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.101771] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.101771] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.101925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.101996] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.102120] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.102173] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.102375] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.102468] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.102536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.102675] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.102761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.103454] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c07d505c-f980-415b-83f4-7e47978f1133 is going to be updated. [ 695.129239] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 in Status: SUCCESS [ 695.129435] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 deletion is rescheduled due to dependency. [ 695.129605] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.144551] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.144767] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.144886] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.145279] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.145476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.145678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c07d505c-f980-415b-83f4-7e47978f1133" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.292721] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b in Status: SUCCESS [ 695.296830] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.297599] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.297922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.301381] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.301381] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.301381] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.301381] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.301381] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.301381] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.301381] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4672e8d-a5ca-46f8-8d7b-adf4da6e472b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.467888] env[66994]: INFO networking_nsxv3.common.synchronization [req-45ab1352-5102-4f4b-b1b7-9209ced57f8b req-0dd1dff2-9b4a-477f-838e-34c77da188f8 tempest-ListImageFiltersTestJSON-572163632 tempest-ListImageFiltersTestJSON-572163632-project-member] Enqueued Resource ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e with Priority: HIGHEST for action security_group_members [ 695.470215] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e with Priority: HIGHEST for action security_group_members [ 695.470590] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.470729] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.471216] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.471438] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.471648] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.471757] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.471820] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.472019] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.474033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.474033] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aaddbb4b-3076-42ef-afd8-2dcbedf8773e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.485294] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 in Status: SUCCESS [ 695.485294] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.485294] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.485294] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.485294] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.485294] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.485294] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.485294] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.485294] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.485294] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.606106] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cda947aa-81ac-4826-ab42-0806fdd02361',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.803976] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4672e8d-a5ca-46f8-8d7b-adf4da6e472b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.976724] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.976724] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.976724] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.976920] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.977042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.977269] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.977397] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.977490] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.977732] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.977840] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.977951] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e already deleted. [ 695.978111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.987829] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.109391] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.109591] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.109654] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.109912] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.110011] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.110122] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cda947aa-81ac-4826-ab42-0806fdd02361 is going to be created. [ 696.142957] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.143213] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.143290] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.143652] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.143839] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.163426] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cda947aa-81ac-4826-ab42-0806fdd02361 in Status: UNINITIALIZED for 2s [ 696.306799] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4672e8d-a5ca-46f8-8d7b-adf4da6e472b: rpc.has_security_group_logging(os_id): False [ 696.332498] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.332628] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.332712] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.332910] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.332988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.333318] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.333476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.333558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.334813] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.334813] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.334813] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b is going to be created. [ 696.440268] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.440987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.441175] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.441518] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.441797] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.459905] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b in Status: IN_PROGRESS for 2s [ 696.491425] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.896958] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.897678] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.897678] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.897678] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.897942] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.898225] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.899317] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.899317] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.899317] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.899317] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 696.899744] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 696.899744] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 696.900316] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 696.900691] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 696.900857] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 696.902199] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 696.905135] env[66994]: INFO networking_nsxv3.common.synchronization [None req-35d6e9f1-e73c-40d1-a968-3f99dcf41d3b None None] Enqueued Resource ID: f8c934ba-ae58-41d1-8fd0-0f1f53ecea46 with Priority: HIGHEST for action port [ 696.906399] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8c934ba-ae58-41d1-8fd0-0f1f53ecea46 with Priority: HIGHEST for action port [ 696.906956] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8c934ba-ae58-41d1-8fd0-0f1f53ecea46 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.907221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8c934ba-ae58-41d1-8fd0-0f1f53ecea46" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.907348] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8c934ba-ae58-41d1-8fd0-0f1f53ecea46" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.907740] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8c934ba-ae58-41d1-8fd0-0f1f53ecea46" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.907854] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8c934ba-ae58-41d1-8fd0-0f1f53ecea46',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.924060] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 696.924297] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 696.924535] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 696.925077] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.925227] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-8e0fc3c6-a2e2-4b58-ab23-0cb00b3a52ae taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.925433] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-8e0fc3c6-a2e2-4b58-ab23-0cb00b3a52ae" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.925582] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-8e0fc3c6-a2e2-4b58-ab23-0cb00b3a52ae" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.925940] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-8e0fc3c6-a2e2-4b58-ab23-0cb00b3a52ae" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.926128] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e0fc3c6-a2e2-4b58-ab23-0cb00b3a52ae',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.992963] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.993195] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.993333] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.993850] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.993850] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.993916] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 is going to be updated. [ 697.038439] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.038614] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.038743] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.039107] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.039107] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.051467] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 in Status: IN_PROGRESS for 2s [ 697.412108] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8c934ba-ae58-41d1-8fd0-0f1f53ecea46 [ 697.412108] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.412108] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.412108] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.412464] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.412464] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.412464] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8c934ba-ae58-41d1-8fd0-0f1f53ecea46 already deleted. [ 697.412464] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8c934ba-ae58-41d1-8fd0-0f1f53ecea46" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.429268] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.429548] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.429660] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.430078] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.430306] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.430520] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 8e0fc3c6-a2e2-4b58-ab23-0cb00b3a52ae not found, creating... [ 697.430864] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.431160] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.431327] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.433806] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.433998] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.434573] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.434798] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.434968] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.435285] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.436038] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.436038] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 8e0fc3c6-a2e2-4b58-ab23-0cb00b3a52ae is going to be created. [ 697.465335] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.469972] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.469972] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.469972] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.469972] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.469972] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-8e0fc3c6-a2e2-4b58-ab23-0cb00b3a52ae" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.177806] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cda947aa-81ac-4826-ab42-0806fdd02361 in Status: SUCCESS [ 698.178186] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.178231] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.178445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.178661] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.178751] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.178817] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.178968] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.179072] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.179159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.179251] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cda947aa-81ac-4826-ab42-0806fdd02361',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.215521] env[66994]: INFO networking_nsxv3.common.synchronization [req-45ab1352-5102-4f4b-b1b7-9209ced57f8b req-2157f138-69ec-408a-8385-720a29b81606 service nova] Enqueued Resource ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e with Priority: HIGHEST for action security_group_rules [ 698.215746] env[66994]: INFO networking_nsxv3.common.synchronization [req-45ab1352-5102-4f4b-b1b7-9209ced57f8b req-2157f138-69ec-408a-8385-720a29b81606 service nova] Enqueued Resource ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e with Priority: HIGHEST for action security_group_members [ 698.215868] env[66994]: INFO networking_nsxv3.common.synchronization [req-45ab1352-5102-4f4b-b1b7-9209ced57f8b req-2157f138-69ec-408a-8385-720a29b81606 service nova] Enqueued Resource ID: 8e0fc3c6-a2e2-4b58-ab23-0cb00b3a52ae with Priority: HIGHEST for action port [ 698.216730] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e with Priority: HIGHEST for action security_group_rules [ 698.216864] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e with Priority: HIGHEST for action security_group_members [ 698.216960] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e0fc3c6-a2e2-4b58-ab23-0cb00b3a52ae with Priority: HIGHEST for action port [ 698.217552] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aaddbb4b-3076-42ef-afd8-2dcbedf8773e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.217711] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.217816] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.218124] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.218211] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aaddbb4b-3076-42ef-afd8-2dcbedf8773e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.219055] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.219168] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.219236] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.219411] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.219555] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.219644] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.219738] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.219834] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.221563] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.221563] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aaddbb4b-3076-42ef-afd8-2dcbedf8773e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.221563] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e0fc3c6-a2e2-4b58-ab23-0cb00b3a52ae taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.221563] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e0fc3c6-a2e2-4b58-ab23-0cb00b3a52ae" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.221563] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e0fc3c6-a2e2-4b58-ab23-0cb00b3a52ae" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.221563] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e0fc3c6-a2e2-4b58-ab23-0cb00b3a52ae" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.221563] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e0fc3c6-a2e2-4b58-ab23-0cb00b3a52ae',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.476516] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b in Status: SUCCESS [ 698.476516] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.682358] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-cda947aa-81ac-4826-ab42-0806fdd02361 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.682486] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.682582] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.682890] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.683162] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.683312] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.683444] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.683653] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.683799] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.683952] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.684206] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-cda947aa-81ac-4826-ab42-0806fdd02361 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.685107] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.685107] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.685107] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.685107] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.686117] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.686214] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.686383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.686468] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.686553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.686672] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cda947aa-81ac-4826-ab42-0806fdd02361',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.724246] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e0fc3c6-a2e2-4b58-ab23-0cb00b3a52ae with status ACTIVE [ 698.724616] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.724769] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.724834] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.726020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.726020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.726020] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.726020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.726020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.726020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.726020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.726020] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.726020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.726354] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.726354] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.726354] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.726354] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e0fc3c6-a2e2-4b58-ab23-0cb00b3a52ae is going to be updated. [ 698.730918] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.730918] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.730918] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aaddbb4b-3076-42ef-afd8-2dcbedf8773e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.765912] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.766076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.766146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.766362] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.766502] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.766681] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e0fc3c6-a2e2-4b58-ab23-0cb00b3a52ae" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.069476] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 in Status: SUCCESS [ 699.069476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.069476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.069476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.069476] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.069476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.069476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.069992] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.069992] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.069992] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.069992] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.190300] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cda947aa-81ac-4826-ab42-0806fdd02361: rpc.has_security_group_logging(os_id): False [ 699.216023] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.216180] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.216238] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.220029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.220029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.220029] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.220029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.220029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.220029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.220029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.220029] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.220029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.220029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.220029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.220029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.220029] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.220029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.220931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.220931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.220931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.220931] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cda947aa-81ac-4826-ab42-0806fdd02361 is going to be created. [ 699.232139] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aaddbb4b-3076-42ef-afd8-2dcbedf8773e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.309768] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.309995] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.310100] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.310435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.310724] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.331173] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cda947aa-81ac-4826-ab42-0806fdd02361 in Status: IN_PROGRESS for 2s [ 699.572621] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdf001c-b425-433f-b4c2-dcd41fc81f02 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.572794] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.572848] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.573112] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.574085] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.574085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.574085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.574085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.574085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.574085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.574085] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdf001c-b425-433f-b4c2-dcd41fc81f02 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.574085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.574085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.574543] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.574543] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.574543] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.574543] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.574724] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.574724] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.574802] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.574936] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.736065] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.736288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.736601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.736703] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.736962] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.736962] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e is going to be created. [ 699.768090] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.768090] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.768244] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.768347] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.768516] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.782985] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e in Status: UNINITIALIZED for 2s [ 699.905201] env[66994]: INFO networking_nsxv3.common.synchronization [None req-0837596a-1885-4429-95b2-d01b621c3310 None None] Enqueued Resource ID: 4bd5019c-d6a6-43c1-9bef-375a0d3ab91f with Priority: HIGHEST for action port [ 699.909978] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bd5019c-d6a6-43c1-9bef-375a0d3ab91f with Priority: HIGHEST for action port [ 699.911074] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bd5019c-d6a6-43c1-9bef-375a0d3ab91f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.911074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bd5019c-d6a6-43c1-9bef-375a0d3ab91f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.911074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bd5019c-d6a6-43c1-9bef-375a0d3ab91f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.913770] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bd5019c-d6a6-43c1-9bef-375a0d3ab91f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.913770] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bd5019c-d6a6-43c1-9bef-375a0d3ab91f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.982021] env[66994]: INFO networking_nsxv3.common.synchronization [req-dc10d8a1-85c1-45a3-bdf2-7586294aefc8 req-aedee0ac-9ec0-4c34-afec-be692ccf9308 tempest-MultipleCreateTestJSON-651107876 tempest-MultipleCreateTestJSON-651107876-project-member] Enqueued Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 699.982564] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 699.982863] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.982989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.984248] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.984567] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.984840] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.985035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.986281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.986281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.986281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.986281] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.059455] env[66994]: INFO networking_nsxv3.common.synchronization [req-1fecc746-9ed8-4bb7-a411-c21650c06420 req-9d6df2a3-7235-46f7-9cc7-77b58bd6d08a tempest-ListImageFiltersTestJSON-572163632 tempest-ListImageFiltersTestJSON-572163632-project-member] Enqueued Resource ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e with Priority: HIGHEST for action security_group_members [ 700.060043] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e with Priority: HIGHEST for action security_group_members [ 700.060364] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.060471] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.079379] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fdf001c-b425-433f-b4c2-dcd41fc81f02: rpc.has_security_group_logging(os_id): False [ 700.103080] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.103385] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.104118] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.105073] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.105073] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.105073] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.105073] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.105569] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.107116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.107116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.107116] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.107116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.107116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.107116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.107116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.107378] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.107378] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.107378] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.107539] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.107572] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.107705] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 is going to be updated. [ 700.180837] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.181844] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.182430] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.182430] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.182629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.198478] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 in Status: IN_PROGRESS for 2s [ 700.416603] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4bd5019c-d6a6-43c1-9bef-375a0d3ab91f [ 700.416990] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.417234] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.417350] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.417590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.417702] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.417817] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4bd5019c-d6a6-43c1-9bef-375a0d3ab91f already deleted. [ 700.417893] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bd5019c-d6a6-43c1-9bef-375a0d3ab91f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.492135] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.572992] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.574214] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.574214] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.574214] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.574214] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.574214] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.574534] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.574534] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.574736] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.575017] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 700.575136] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 700.575242] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 700.575343] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 700.575447] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 700.575543] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 700.575670] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 700.597128] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 700.597289] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 700.597478] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 700.599241] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.599241] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-a0740c1d-84ea-4717-9782-57ec803abd00 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.599241] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-a0740c1d-84ea-4717-9782-57ec803abd00" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.599241] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-a0740c1d-84ea-4717-9782-57ec803abd00" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.599241] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-a0740c1d-84ea-4717-9782-57ec803abd00" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.599241] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0740c1d-84ea-4717-9782-57ec803abd00',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.995413] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.101360] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.101686] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.101973] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.102257] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.102440] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.102639] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port a0740c1d-84ea-4717-9782-57ec803abd00 not found, creating... [ 701.103016] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.103238] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.103395] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.103781] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.103967] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.104463] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.104639] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.104757] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.104973] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.105123] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.105294] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: a0740c1d-84ea-4717-9782-57ec803abd00 is going to be created. [ 701.129084] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.129590] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.129839] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.130264] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.130562] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.130794] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-a0740c1d-84ea-4717-9782-57ec803abd00" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.349987] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cda947aa-81ac-4826-ab42-0806fdd02361 in Status: SUCCESS [ 701.350418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.498676] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.498873] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.498948] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.499200] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.499297] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.499398] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 is going to be updated. [ 701.545140] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.545524] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.545720] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.546086] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.546367] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.561842] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: IN_PROGRESS for 2s [ 701.790999] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e in Status: SUCCESS [ 701.790999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.791092] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.791304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.791492] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.791664] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.791766] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.791953] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.792052] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.792144] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.792242] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aaddbb4b-3076-42ef-afd8-2dcbedf8773e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.793514] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.793514] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.793794] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.793794] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.793896] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.794130] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.794266] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.795155] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aaddbb4b-3076-42ef-afd8-2dcbedf8773e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.862464] env[66994]: INFO networking_nsxv3.common.synchronization [req-1fecc746-9ed8-4bb7-a411-c21650c06420 req-a9f0bdbc-b3bd-4f88-b6d4-e65bf3d7f3e0 service nova] Enqueued Resource ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e with Priority: HIGHEST for action security_group_rules [ 701.863094] env[66994]: INFO networking_nsxv3.common.synchronization [req-1fecc746-9ed8-4bb7-a411-c21650c06420 req-a9f0bdbc-b3bd-4f88-b6d4-e65bf3d7f3e0 service nova] Enqueued Resource ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e with Priority: HIGHEST for action security_group_members [ 701.863094] env[66994]: INFO networking_nsxv3.common.synchronization [req-1fecc746-9ed8-4bb7-a411-c21650c06420 req-a9f0bdbc-b3bd-4f88-b6d4-e65bf3d7f3e0 service nova] Enqueued Resource ID: a0740c1d-84ea-4717-9782-57ec803abd00 with Priority: HIGHEST for action port [ 701.863468] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e with Priority: HIGHEST for action security_group_rules [ 701.863636] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e with Priority: HIGHEST for action security_group_members [ 701.863679] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0740c1d-84ea-4717-9782-57ec803abd00 with Priority: HIGHEST for action port [ 701.864022] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aaddbb4b-3076-42ef-afd8-2dcbedf8773e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.865120] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.865449] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.865589] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.865853] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0740c1d-84ea-4717-9782-57ec803abd00 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.865975] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0740c1d-84ea-4717-9782-57ec803abd00" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.866094] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0740c1d-84ea-4717-9782-57ec803abd00" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.866337] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0740c1d-84ea-4717-9782-57ec803abd00" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.866466] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0740c1d-84ea-4717-9782-57ec803abd00',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.881522] env[66994]: INFO networking_nsxv3.common.synchronization [req-28da14d6-9a89-43c0-b71c-00d5402f846c req-6e71863b-12e5-4588-a61c-0bd916684b66 tempest-VolumesAssistedSnapshotsTest-1112260893 tempest-VolumesAssistedSnapshotsTest-1112260893-project-member] Enqueued Resource ID: dbf01905-0f34-4b82-885d-141b364fdeab with Priority: HIGHEST for action security_group_members [ 701.882645] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf01905-0f34-4b82-885d-141b364fdeab with Priority: HIGHEST for action security_group_members [ 701.882970] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf01905-0f34-4b82-885d-141b364fdeab taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.883181] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.883292] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.883601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.884104] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.884104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.884104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.884299] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.884443] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.884600] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbf01905-0f34-4b82-885d-141b364fdeab',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.216505] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 in Status: SUCCESS [ 702.216758] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.216920] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.217199] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.217338] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.298117] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.298365] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.298548] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aaddbb4b-3076-42ef-afd8-2dcbedf8773e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.371138] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a0740c1d-84ea-4717-9782-57ec803abd00 with status ACTIVE [ 702.371628] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.371773] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.371859] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.372114] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.372245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.372408] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.372635] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.372635] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.372690] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.372830] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.372928] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.373028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.373086] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.373244] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.373320] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.373407] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a0740c1d-84ea-4717-9782-57ec803abd00 is going to be updated. [ 702.387241] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.387380] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.387428] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.388028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.388028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.388126] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.388180] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.388284] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.388425] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.388535] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.388636] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbf01905-0f34-4b82-885d-141b364fdeab is going to be updated. [ 702.402586] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.402747] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.402821] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.403068] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.403212] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.403494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0740c1d-84ea-4717-9782-57ec803abd00" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.424567] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.424676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.424729] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.424985] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.425103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.435038] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbf01905-0f34-4b82-885d-141b364fdeab in Status: IN_PROGRESS for 2s [ 702.449512] env[66994]: INFO networking_nsxv3.common.synchronization [req-6f2ae5e2-fd4e-45db-83f7-5d6234878dec req-5a57cbeb-a1a7-49f3-a1c7-5292680ebc55 tempest-MultipleCreateTestJSON-651107876 tempest-MultipleCreateTestJSON-651107876-project-member] Enqueued Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 702.450549] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 702.452439] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.452439] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.721566] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdf001c-b425-433f-b4c2-dcd41fc81f02 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.721823] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.722035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.723366] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.723663] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.723899] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.724033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.726069] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.726069] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.726069] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.726069] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.803322] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aaddbb4b-3076-42ef-afd8-2dcbedf8773e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.992171] env[66994]: INFO networking_nsxv3.common.synchronization [req-86e320ab-d5d8-4c48-b9d7-b62fde13b2a5 req-95d5e1c3-418a-48a8-9ec3-d35ee502fad9 tempest-ServerDiagnosticsTest-3528994 tempest-ServerDiagnosticsTest-3528994-project-member] Enqueued Resource ID: fa1b7e95-7684-4712-b323-6d410e0e0d5b with Priority: HIGHEST for action security_group_members [ 702.993208] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa1b7e95-7684-4712-b323-6d410e0e0d5b with Priority: HIGHEST for action security_group_members [ 702.995048] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa1b7e95-7684-4712-b323-6d410e0e0d5b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.995048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.995048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.995048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.995048] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.995048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.995048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.995048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.995048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.995048] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa1b7e95-7684-4712-b323-6d410e0e0d5b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.228465] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdf001c-b425-433f-b4c2-dcd41fc81f02 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.230707] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.230707] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.230707] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.230707] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.230707] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.230707] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.230707] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.230707] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.230707] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.230707] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdf001c-b425-433f-b4c2-dcd41fc81f02 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.230707] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.230707] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.231273] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.231273] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.231273] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.231273] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.233023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.233195] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.234408] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.234408] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.306342] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.306511] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.306636] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.306847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.306899] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.307014] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e is going to be updated. [ 703.340369] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.340593] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.340659] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.340888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.341067] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.350142] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e in Status: IN_PROGRESS for 2s [ 703.500789] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.500789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.500789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.500789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.500789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.500789] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.500789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.500789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.500789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.500789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.500789] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa1b7e95-7684-4712-b323-6d410e0e0d5b is going to be updated. [ 703.528847] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.528847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.528847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.528847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.528847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.537717] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa1b7e95-7684-4712-b323-6d410e0e0d5b in Status: IN_PROGRESS for 2s [ 703.572198] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: SUCCESS [ 703.572422] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.572641] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.572809] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.572995] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.573124] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.573293] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.573413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.573550] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.573651] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.737092] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fdf001c-b425-433f-b4c2-dcd41fc81f02: rpc.has_security_group_logging(os_id): False [ 703.763569] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.763569] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.763569] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.763569] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.763761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.763988] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.763988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.764094] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.764488] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.764696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.764762] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.764858] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.764918] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.765079] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.765149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.765397] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.765515] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.765822] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.765976] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.766057] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.766146] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 is going to be updated. [ 703.848233] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.848452] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.848562] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.848857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.849114] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.871077] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 in Status: IN_PROGRESS for 2s [ 704.076272] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.077023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.077023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.077300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.077574] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.077908] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.078205] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.078267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.078551] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.079351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.080087] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 is going to be updated. [ 704.116058] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.116260] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.116385] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.116703] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.116926] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.131693] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: IN_PROGRESS for 2s [ 704.450049] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbf01905-0f34-4b82-885d-141b364fdeab in Status: SUCCESS [ 704.450049] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbf01905-0f34-4b82-885d-141b364fdeab deletion is rescheduled due to dependency. [ 704.450049] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.322846] env[66994]: INFO networking_nsxv3.common.synchronization [req-0fbe7c11-05cf-4fe9-aa19-d65c0f6a0339 req-21a308cc-0e8d-4528-9396-4b926e9d91c2 tempest-ServersTestJSON-587851554 tempest-ServersTestJSON-587851554-project-member] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 705.323586] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 705.323758] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.324133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.324133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.324349] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.324382] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.324497] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.324528] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.325101] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.325101] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.325101] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.362898] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e in Status: SUCCESS [ 705.362898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.362898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.362898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.362898] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.362898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.362898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.362898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.362898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.362898] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aaddbb4b-3076-42ef-afd8-2dcbedf8773e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.549255] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa1b7e95-7684-4712-b323-6d410e0e0d5b in Status: SUCCESS [ 705.549478] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa1b7e95-7684-4712-b323-6d410e0e0d5b deletion is rescheduled due to dependency. [ 705.549601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.826439] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.826632] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.826701] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.826910] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.827011] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.827220] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.828082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.828082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.828082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.828082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.828082] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 already deleted. [ 705.828082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.847675] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.847872] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.847990] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.848467] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.848722] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.848881] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.848989] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.849218] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.849358] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.849553] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 705.849677] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 705.849760] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 705.849859] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 705.849959] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 705.850070] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 705.850194] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.866520] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aaddbb4b-3076-42ef-afd8-2dcbedf8773e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.874791] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.875123] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 705.875193] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.875446] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.875945] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-50b87375-ff4f-41c8-b9a5-f61ba903d321 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.876171] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-50b87375-ff4f-41c8-b9a5-f61ba903d321" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.876320] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-50b87375-ff4f-41c8-b9a5-f61ba903d321" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.877053] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-50b87375-ff4f-41c8-b9a5-f61ba903d321" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.877141] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50b87375-ff4f-41c8-b9a5-f61ba903d321',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.889918] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 in Status: SUCCESS [ 705.890158] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.147155] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: SUCCESS [ 706.147339] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 deletion is rescheduled due to dependency. [ 706.147455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.370053] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aaddbb4b-3076-42ef-afd8-2dcbedf8773e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.379747] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.379974] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.380112] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.380402] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.380572] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.381036] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 50b87375-ff4f-41c8-b9a5-f61ba903d321 not found, creating... [ 706.381036] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.381171] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.381274] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.381579] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.381741] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.382045] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.382210] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.382323] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.382539] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.382669] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.382801] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 50b87375-ff4f-41c8-b9a5-f61ba903d321 is going to be created. [ 706.411554] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.412044] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.412044] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.412198] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.412457] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.412758] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-50b87375-ff4f-41c8-b9a5-f61ba903d321" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.449918] env[66994]: INFO networking_nsxv3.common.synchronization [None req-47c636c5-22cd-4912-b7bd-abc717b1138d None None] Enqueued Resource ID: ec8ad39b-f714-4e50-a7a9-f980967a1229 with Priority: HIGHEST for action port [ 706.450815] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec8ad39b-f714-4e50-a7a9-f980967a1229 with Priority: HIGHEST for action port [ 706.450815] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec8ad39b-f714-4e50-a7a9-f980967a1229 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.451376] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec8ad39b-f714-4e50-a7a9-f980967a1229" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.451376] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec8ad39b-f714-4e50-a7a9-f980967a1229" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.453710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec8ad39b-f714-4e50-a7a9-f980967a1229" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.453828] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec8ad39b-f714-4e50-a7a9-f980967a1229',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.874287] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.874467] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.874523] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.874832] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.874956] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.875085] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e is going to be updated. [ 706.924404] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.924836] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.924836] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.924981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.925152] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.937811] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e in Status: IN_PROGRESS for 2s [ 706.957367] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec8ad39b-f714-4e50-a7a9-f980967a1229 [ 706.957673] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.957846] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.957922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.958208] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.958276] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.958377] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec8ad39b-f714-4e50-a7a9-f980967a1229 already deleted. [ 706.958521] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec8ad39b-f714-4e50-a7a9-f980967a1229" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.154753] env[66994]: INFO networking_nsxv3.common.synchronization [req-0fbe7c11-05cf-4fe9-aa19-d65c0f6a0339 req-50b54f2b-04d8-4e30-8177-3987b85f2a64 service nova] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_rules [ 707.154753] env[66994]: INFO networking_nsxv3.common.synchronization [req-0fbe7c11-05cf-4fe9-aa19-d65c0f6a0339 req-50b54f2b-04d8-4e30-8177-3987b85f2a64 service nova] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 707.154753] env[66994]: INFO networking_nsxv3.common.synchronization [req-0fbe7c11-05cf-4fe9-aa19-d65c0f6a0339 req-50b54f2b-04d8-4e30-8177-3987b85f2a64 service nova] Enqueued Resource ID: 50b87375-ff4f-41c8-b9a5-f61ba903d321 with Priority: HIGHEST for action port [ 707.155627] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_rules [ 707.155627] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 707.155769] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50b87375-ff4f-41c8-b9a5-f61ba903d321 with Priority: HIGHEST for action port [ 707.156151] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.156312] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.156393] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.156715] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.156835] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.160167] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.160167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.160167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.160167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.160167] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.160573] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.160573] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.160573] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.160573] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.160573] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.161537] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-50b87375-ff4f-41c8-b9a5-f61ba903d321 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.161683] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50b87375-ff4f-41c8-b9a5-f61ba903d321" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.161743] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50b87375-ff4f-41c8-b9a5-f61ba903d321" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.161875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50b87375-ff4f-41c8-b9a5-f61ba903d321" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.161988] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50b87375-ff4f-41c8-b9a5-f61ba903d321',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.663839] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.665031] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.665925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.665925] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 50b87375-ff4f-41c8-b9a5-f61ba903d321 with status ACTIVE [ 707.665925] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.665925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.666143] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.666217] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.666307] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.666474] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.666956] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.666956] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.666956] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.672685] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.672685] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.672685] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.672685] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.672685] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.672685] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.672685] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 50b87375-ff4f-41c8-b9a5-f61ba903d321 is going to be updated. [ 707.699547] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.699698] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.699774] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.699984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.700132] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.700294] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50b87375-ff4f-41c8-b9a5-f61ba903d321" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.874142] env[66994]: INFO networking_nsxv3.common.synchronization [req-5caeb05e-bffd-4450-977b-325c1a6e5622 req-04d20ac3-fb9b-4eb7-9080-28c60d3952e8 tempest-ServersAdminTestJSON-1722983547 tempest-ServersAdminTestJSON-1722983547-project-member] Enqueued Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 707.875378] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 707.875378] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.875562] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.875660] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.875924] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.877225] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.877225] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.877225] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.877225] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.877225] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.877225] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.174285] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.272416] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-237 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.272670] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.273973] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.273973] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.273973] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.273973] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.274240] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.274555] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.274555] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.274792] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 708.274908] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 708.275025] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 708.275132] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 708.275238] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 708.275337] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 708.275467] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 708.311354] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 708.311720] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 708.311817] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 708.311932] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.312373] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-ff44c4a8-cec1-4a3e-9dc3-8490cbd7a1ce taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.312551] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-ff44c4a8-cec1-4a3e-9dc3-8490cbd7a1ce" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.312691] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-ff44c4a8-cec1-4a3e-9dc3-8490cbd7a1ce" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.313099] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-ff44c4a8-cec1-4a3e-9dc3-8490cbd7a1ce" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.313263] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff44c4a8-cec1-4a3e-9dc3-8490cbd7a1ce',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.379284] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.677094] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.677447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.677447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.677684] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.677684] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.677817] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be created. [ 708.704685] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.704866] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.704993] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.705190] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.705351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.717887] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: UNINITIALIZED for 2s [ 708.816715] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.817060] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.817289] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.817730] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.818161] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.818620] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port ff44c4a8-cec1-4a3e-9dc3-8490cbd7a1ce not found, creating... [ 708.818892] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.819444] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.819776] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.819979] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.820230] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.820638] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.821136] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.821299] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.821805] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.822401] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.822621] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: ff44c4a8-cec1-4a3e-9dc3-8490cbd7a1ce is going to be created. [ 708.845602] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.846045] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.846300] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.846524] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.846757] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.847116] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-ff44c4a8-cec1-4a3e-9dc3-8490cbd7a1ce" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.857657] env[66994]: INFO networking_nsxv3.common.synchronization [None req-36fd099d-d17e-4f82-a407-0e60f8e26877 None None] Enqueued Resource ID: ae9ed0c1-9856-469d-89e3-87edc2268918 with Priority: HIGHEST for action port [ 708.857919] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9ed0c1-9856-469d-89e3-87edc2268918 with Priority: HIGHEST for action port [ 708.858512] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae9ed0c1-9856-469d-89e3-87edc2268918 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.858643] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae9ed0c1-9856-469d-89e3-87edc2268918" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.858708] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae9ed0c1-9856-469d-89e3-87edc2268918" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.858988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae9ed0c1-9856-469d-89e3-87edc2268918" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.859115] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae9ed0c1-9856-469d-89e3-87edc2268918',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.883377] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.954022] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e in Status: SUCCESS [ 708.954022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.954022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.954022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.954022] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.954022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.954022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.954022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.954022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.954022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.954022] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.954625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.954838] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.955106] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.955390] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.956820] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.956820] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.956820] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.956820] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.956820] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.956820] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aaddbb4b-3076-42ef-afd8-2dcbedf8773e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.360780] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae9ed0c1-9856-469d-89e3-87edc2268918 [ 709.361914] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.361914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.361914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.361914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.361914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.361914] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae9ed0c1-9856-469d-89e3-87edc2268918 already deleted. [ 709.362134] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae9ed0c1-9856-469d-89e3-87edc2268918" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.386298] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.386298] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.386455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.386563] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.386649] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.386867] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 is going to be updated. [ 709.425673] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.426138] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.426316] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.426554] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.426706] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.438023] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: IN_PROGRESS for 2s [ 709.460567] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aaddbb4b-3076-42ef-afd8-2dcbedf8773e: rpc.has_security_group_logging(os_id): False [ 709.481277] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.481277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.481554] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.485024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.485024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.485024] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.485024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.485024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.485024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.485024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.485024] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.485024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.485024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.485024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.485024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.485024] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.485024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.486246] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.486246] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.486246] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.486246] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e is going to be created. [ 709.611328] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.611613] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.611694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.611916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.612332] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.631966] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e in Status: IN_PROGRESS for 2s [ 709.673034] env[66994]: INFO networking_nsxv3.common.synchronization [req-5caeb05e-bffd-4450-977b-325c1a6e5622 req-22747433-fafa-4467-a467-3e4d1452eb45 service nova] Enqueued Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_rules [ 709.673034] env[66994]: INFO networking_nsxv3.common.synchronization [req-5caeb05e-bffd-4450-977b-325c1a6e5622 req-22747433-fafa-4467-a467-3e4d1452eb45 service nova] Enqueued Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 709.673034] env[66994]: INFO networking_nsxv3.common.synchronization [req-5caeb05e-bffd-4450-977b-325c1a6e5622 req-22747433-fafa-4467-a467-3e4d1452eb45 service nova] Enqueued Resource ID: ff44c4a8-cec1-4a3e-9dc3-8490cbd7a1ce with Priority: HIGHEST for action port [ 709.673034] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_rules [ 709.673034] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 709.673034] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff44c4a8-cec1-4a3e-9dc3-8490cbd7a1ce with Priority: HIGHEST for action port [ 709.673034] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.673034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.673034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.673034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.673034] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.675639] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.675745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.675996] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff44c4a8-cec1-4a3e-9dc3-8490cbd7a1ce taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.676123] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff44c4a8-cec1-4a3e-9dc3-8490cbd7a1ce" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.676190] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff44c4a8-cec1-4a3e-9dc3-8490cbd7a1ce" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.676406] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff44c4a8-cec1-4a3e-9dc3-8490cbd7a1ce" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.676519] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff44c4a8-cec1-4a3e-9dc3-8490cbd7a1ce',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.178568] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.178978] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.178978] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff44c4a8-cec1-4a3e-9dc3-8490cbd7a1ce with status ACTIVE [ 710.179119] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.179234] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.179305] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.179523] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.179615] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.179788] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.179880] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.180009] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.180112] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.180183] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.180404] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.180508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.180624] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.180776] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.180776] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.180869] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff44c4a8-cec1-4a3e-9dc3-8490cbd7a1ce is going to be updated. [ 710.205040] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.205602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.205602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.205602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.205907] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.206060] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff44c4a8-cec1-4a3e-9dc3-8490cbd7a1ce" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.374558] env[66994]: INFO networking_nsxv3.common.synchronization [req-c6acefc5-16ea-4662-96f1-88c8dbf77b5d req-3fe403e1-e858-4f82-8da3-dea22317caef tempest-ListServersNegativeTestJSON-1189554403 tempest-ListServersNegativeTestJSON-1189554403-project-member] Enqueued Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_members [ 710.374754] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_members [ 710.375080] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdf001c-b425-433f-b4c2-dcd41fc81f02 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.375241] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.375327] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.375587] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.375797] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.376105] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.376202] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.376392] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.376473] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.376579] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.730175] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 710.730431] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.730608] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.730827] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.731052] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.731180] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.731474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.731474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.731474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.731589] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.731650] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.879204] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.235454] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.235454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.239077] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.239397] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.239620] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.239868] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.240645] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.240645] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.240645] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.240645] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.240645] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.240945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.240945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.241446] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.241446] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.241555] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.241585] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.241733] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.241849] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.241941] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.242099] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.383574] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.450753] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: SUCCESS [ 711.451331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.451331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.451890] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.452131] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.452296] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.452384] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.452664] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.452729] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.452839] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.643399] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e in Status: SUCCESS [ 711.643399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.643399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.643399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.643399] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aaddbb4b-3076-42ef-afd8-2dcbedf8773e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.748114] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8: rpc.has_security_group_logging(os_id): False [ 711.766194] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.766194] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.766194] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.766194] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.766194] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.766194] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.766194] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.766194] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.766194] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.766808] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.767493] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.767493] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.767493] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.767493] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.767493] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.768494] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.768494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.768494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.768494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.768494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.768494] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be created. [ 711.853036] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.853036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.853036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.853036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.853036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.867285] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 711.889709] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.889709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.889709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.889709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.889709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.889709] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 is going to be updated. [ 711.944311] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.944520] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.944581] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.944763] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.944911] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.956351] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.966401] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 in Status: IN_PROGRESS for 2s [ 712.146529] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.146760] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.147037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.147819] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.147819] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.147819] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.147819] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.147819] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.147819] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.147819] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.148131] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aaddbb4b-3076-42ef-afd8-2dcbedf8773e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.459232] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.653864] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.653864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.653864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.653864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.653864] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.653864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.653864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.653864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.653864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.653864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.653864] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.653864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.653864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.654690] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.654690] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.654690] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.654690] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.654819] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.654875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.655039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.655178] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aaddbb4b-3076-42ef-afd8-2dcbedf8773e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.963506] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.963506] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.963506] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.963733] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.963779] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.967139] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 is going to be updated. [ 713.017528] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.017692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.017738] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.018256] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.018496] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.033306] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: IN_PROGRESS for 2s [ 713.165251] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aaddbb4b-3076-42ef-afd8-2dcbedf8773e: rpc.has_security_group_logging(os_id): False [ 713.187211] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.187408] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.187508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.187968] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.188123] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.188393] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.188550] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.188639] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.188871] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.188973] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.189233] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.189360] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.189446] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.189630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.189730] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.189991] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.190324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.190447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.190639] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.190751] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.190878] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e is going to be updated. [ 713.262566] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.262996] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.263530] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.266453] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.266584] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.282402] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e in Status: IN_PROGRESS for 2s [ 713.995190] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 in Status: SUCCESS [ 713.995485] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.003473] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 714.003837] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.607065] env[66994]: INFO networking_nsxv3.common.synchronization [None req-1af6631a-831a-477b-85e5-3b45af31dc19 None None] Enqueued Resource ID: 15f0700c-7c39-442a-b401-33676d90fd14 with Priority: HIGHEST for action port [ 714.608023] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15f0700c-7c39-442a-b401-33676d90fd14 with Priority: HIGHEST for action port [ 714.608023] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-15f0700c-7c39-442a-b401-33676d90fd14 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.608389] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15f0700c-7c39-442a-b401-33676d90fd14" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.609080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15f0700c-7c39-442a-b401-33676d90fd14" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.609080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15f0700c-7c39-442a-b401-33676d90fd14" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.609080] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15f0700c-7c39-442a-b401-33676d90fd14',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.044497] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: SUCCESS [ 715.044942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.045362] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.046235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.046576] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.046690] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.046764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.046940] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.047048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.047159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.047231] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.111575] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15f0700c-7c39-442a-b401-33676d90fd14 [ 715.111719] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.111882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.111985] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.112309] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.112459] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.112625] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15f0700c-7c39-442a-b401-33676d90fd14 already deleted. [ 715.112759] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15f0700c-7c39-442a-b401-33676d90fd14" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.299259] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e in Status: SUCCESS [ 715.299514] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.551517] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.551689] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.551760] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.551977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.552161] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.552261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.552324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.554651] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.554780] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.554884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.555540] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.555540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.555540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.555540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.555540] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.555775] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.555775] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.556884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.556884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.556884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.556884] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.677986] env[66994]: INFO networking_nsxv3.common.synchronization [req-53360d2d-9b7a-4879-90b8-b73fab616823 req-f4bc306b-4688-488c-a946-b98ba27d39f0 tempest-FloatingIPsAssociationTestJSON-1494503625 tempest-FloatingIPsAssociationTestJSON-1494503625-project-member] Enqueued Resource ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea with Priority: HIGHEST for action security_group_members [ 715.678556] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea with Priority: HIGHEST for action security_group_members [ 715.682372] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.682372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.682372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.682372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.682372] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.682372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.682372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.682372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.682372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.682372] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605734aa-d0fb-486b-9d2a-22c70d9dd0ea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.058611] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5dbec57c-866e-4292-acf4-6de3635c21b3: rpc.has_security_group_logging(os_id): False [ 716.080680] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.083375] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.083375] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.083375] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.083375] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.083737] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.083919] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.084013] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.084320] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.084726] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.084726] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.084809] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.084842] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.085046] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.085152] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.086159] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.086234] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.086313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.086503] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.086605] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.086720] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 is going to be updated. [ 716.161662] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.161662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.161662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.161662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.161662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.182368] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: IN_PROGRESS for 2s [ 716.187657] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.187822] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.187894] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.188144] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.188262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.188522] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.188614] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.188614] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.188759] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.188880] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.188927] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea is going to be updated. [ 716.256795] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.256954] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.257030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.257324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.257398] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.267735] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea in Status: IN_PROGRESS for 2s [ 717.072226] env[66994]: INFO networking_nsxv3.common.synchronization [None req-275b342f-8497-4a1e-8024-31e94a65dbf4 None None] Enqueued Resource ID: b3736380-d691-447a-932f-195705ca0475 with Priority: HIGHEST for action port [ 717.072786] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3736380-d691-447a-932f-195705ca0475 with Priority: HIGHEST for action port [ 717.073096] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3736380-d691-447a-932f-195705ca0475 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.073216] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3736380-d691-447a-932f-195705ca0475" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.073281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3736380-d691-447a-932f-195705ca0475" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.073623] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3736380-d691-447a-932f-195705ca0475" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.073623] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3736380-d691-447a-932f-195705ca0475',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.087073] env[66994]: INFO networking_nsxv3.common.synchronization [None req-6acecca8-4609-4ced-a680-7e712e97214b tempest-ServerActionsTestOtherB-1891732265 tempest-ServerActionsTestOtherB-1891732265-project-member] Enqueued Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_rules [ 717.088337] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_rules [ 717.089322] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.089322] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.089467] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.089635] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.089710] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.198213] env[66994]: INFO networking_nsxv3.common.synchronization [None req-fe8ec1b0-b624-4d62-9630-20a2682c6d9a tempest-ServerActionsTestOtherB-1891732265 tempest-ServerActionsTestOtherB-1891732265-project-member] Enqueued Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_rules [ 717.199131] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_rules [ 717.199442] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.199542] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.575442] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3736380-d691-447a-932f-195705ca0475 [ 717.575676] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.575897] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.576044] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.576305] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.577708] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.577708] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3736380-d691-447a-932f-195705ca0475 already deleted. [ 717.577708] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3736380-d691-447a-932f-195705ca0475" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.612686] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.612954] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.613500] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.613500] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.613500] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.613881] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e already deleted. [ 717.613881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.614071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.614649] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.614649] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.140035] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.140399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.140399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.140487] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.140577] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.140682] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e already deleted. [ 718.140811] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.197411] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: SUCCESS [ 718.197623] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.279923] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea in Status: SUCCESS [ 718.280140] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea deletion is rescheduled due to dependency. [ 718.280270] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.692194] env[66994]: INFO networking_nsxv3.common.synchronization [req-d2416942-6ed3-4ba8-9eb8-c12d79e60c2f req-27a00043-c9f0-404d-8f8b-8936b755be72 tempest-ServersAdminNegativeTestJSON-2113491752 tempest-ServersAdminNegativeTestJSON-2113491752-project-member] Enqueued Resource ID: 91e3865c-9322-423a-9d64-5c548ef52da8 with Priority: HIGHEST for action security_group_members [ 718.692728] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91e3865c-9322-423a-9d64-5c548ef52da8 with Priority: HIGHEST for action security_group_members [ 718.693035] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-91e3865c-9322-423a-9d64-5c548ef52da8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.693163] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.693215] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.693412] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.693561] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.693681] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.693751] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.693895] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.694438] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.694719] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91e3865c-9322-423a-9d64-5c548ef52da8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.722066] env[66994]: INFO networking_nsxv3.common.synchronization [req-5ddf766d-28aa-4ac8-b3ee-d4d49f047638 req-56871b11-72a5-4582-b68c-5fc1345019db tempest-ServerGroupTestJSON-1898268120 tempest-ServerGroupTestJSON-1898268120-project-member] Enqueued Resource ID: dec0b14a-938b-49d8-be95-1b62d57e23e2 with Priority: HIGHEST for action security_group_members [ 718.722066] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dec0b14a-938b-49d8-be95-1b62d57e23e2 with Priority: HIGHEST for action security_group_members [ 718.722275] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-dec0b14a-938b-49d8-be95-1b62d57e23e2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.722423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.722465] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.723030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.723030] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.723030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.723030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.723624] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.723624] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.723760] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dec0b14a-938b-49d8-be95-1b62d57e23e2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.091137] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-79 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.091851] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-79" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.091851] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-79" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.092022] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-79" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.093025] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.093025] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.093025] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.093025] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.093025] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.093275] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 719.093275] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 719.093348] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 719.093448] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 719.093553] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 719.093684] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 719.093815] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 719.117739] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 719.117977] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 719.118144] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 719.118322] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-79" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.118645] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-dc8bb6b2-7526-4743-9622-a08d051ad60d taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.118829] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-dc8bb6b2-7526-4743-9622-a08d051ad60d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.118943] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-dc8bb6b2-7526-4743-9622-a08d051ad60d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.119313] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-dc8bb6b2-7526-4743-9622-a08d051ad60d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.119424] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc8bb6b2-7526-4743-9622-a08d051ad60d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.197517] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('91e3865c-9322-423a-9d64-5c548ef52da8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.225605] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.225749] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.225823] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.226096] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.226196] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.226388] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.226486] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.226547] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.226700] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.226785] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.226854] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dec0b14a-938b-49d8-be95-1b62d57e23e2 already deleted. [ 719.226934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.622176] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.622404] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.622513] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.622809] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.622952] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.623124] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port dc8bb6b2-7526-4743-9622-a08d051ad60d not found, creating... [ 719.623384] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.623533] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.623664] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.623882] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.624021] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.624306] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.624455] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.624564] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.624795] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.624924] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.625071] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: dc8bb6b2-7526-4743-9622-a08d051ad60d is going to be created. [ 719.653681] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.653920] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.654046] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.654335] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.654564] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.654816] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-dc8bb6b2-7526-4743-9622-a08d051ad60d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.699662] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('91e3865c-9322-423a-9d64-5c548ef52da8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.202098] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.202504] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.202504] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.202918] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.202918] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.202918] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91e3865c-9322-423a-9d64-5c548ef52da8 is going to be updated. [ 720.244861] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.245216] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.245352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.245617] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.245807] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.256534] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91e3865c-9322-423a-9d64-5c548ef52da8 in Status: IN_PROGRESS for 2s [ 720.376051] env[66994]: INFO networking_nsxv3.common.synchronization [req-5ddf766d-28aa-4ac8-b3ee-d4d49f047638 req-7fb854ab-4398-45b4-8f0c-59cb382926a1 service nova] Enqueued Resource ID: dec0b14a-938b-49d8-be95-1b62d57e23e2 with Priority: HIGHEST for action security_group_rules [ 720.376106] env[66994]: INFO networking_nsxv3.common.synchronization [req-5ddf766d-28aa-4ac8-b3ee-d4d49f047638 req-7fb854ab-4398-45b4-8f0c-59cb382926a1 service nova] Enqueued Resource ID: dec0b14a-938b-49d8-be95-1b62d57e23e2 with Priority: HIGHEST for action security_group_members [ 720.376416] env[66994]: INFO networking_nsxv3.common.synchronization [req-5ddf766d-28aa-4ac8-b3ee-d4d49f047638 req-7fb854ab-4398-45b4-8f0c-59cb382926a1 service nova] Enqueued Resource ID: dc8bb6b2-7526-4743-9622-a08d051ad60d with Priority: HIGHEST for action port [ 720.376759] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dec0b14a-938b-49d8-be95-1b62d57e23e2 with Priority: HIGHEST for action security_group_rules [ 720.376893] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dec0b14a-938b-49d8-be95-1b62d57e23e2 with Priority: HIGHEST for action security_group_members [ 720.376987] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8bb6b2-7526-4743-9622-a08d051ad60d with Priority: HIGHEST for action port [ 720.377411] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dec0b14a-938b-49d8-be95-1b62d57e23e2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.377560] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.377937] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.378024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.378060] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dec0b14a-938b-49d8-be95-1b62d57e23e2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.379349] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-dec0b14a-938b-49d8-be95-1b62d57e23e2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.379576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.379648] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.379828] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.380157] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.380157] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.380157] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.380282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.380351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.380441] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dec0b14a-938b-49d8-be95-1b62d57e23e2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.381884] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc8bb6b2-7526-4743-9622-a08d051ad60d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.382020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc8bb6b2-7526-4743-9622-a08d051ad60d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.382063] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc8bb6b2-7526-4743-9622-a08d051ad60d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.382268] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc8bb6b2-7526-4743-9622-a08d051ad60d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.382332] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc8bb6b2-7526-4743-9622-a08d051ad60d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.757043] env[66994]: INFO networking_nsxv3.common.synchronization [req-71eca4c3-b903-42c5-93ab-d1613f539414 req-afe5286a-d0f1-420a-9078-4bf76c457015 tempest-ServerRescueTestJSON-1208691686 tempest-ServerRescueTestJSON-1208691686-project-member] Enqueued Resource ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f with Priority: HIGHEST for action security_group_members [ 720.757585] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f with Priority: HIGHEST for action security_group_members [ 720.758355] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5a17dbe-38a0-49a6-88df-5879a5d5333f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.758975] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.759122] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.759333] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.759494] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.759593] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.759654] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.759795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.759877] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.760113] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.883044] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-dec0b14a-938b-49d8-be95-1b62d57e23e2 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.883180] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.884279] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dec0b14a-938b-49d8-be95-1b62d57e23e2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.884726] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc8bb6b2-7526-4743-9622-a08d051ad60d with status ACTIVE [ 720.884726] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.884811] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.884844] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.885067] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.885161] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.888639] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.888862] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.888933] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.889181] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.889296] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.889520] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.889698] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.889698] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.889834] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.889911] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.889999] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc8bb6b2-7526-4743-9622-a08d051ad60d is going to be updated. [ 720.914532] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.914742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.914836] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.914979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.915143] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.915301] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc8bb6b2-7526-4743-9622-a08d051ad60d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.166828] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.167075] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-876" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.167209] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-876" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.167490] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-876" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.167775] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.168028] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.168084] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.168484] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.168484] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.168698] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.168830] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.168933] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.169076] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.169200] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.169313] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.169450] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.191991] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.192204] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 721.192337] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.192512] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-876" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.192814] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-6b53b1d8-c2b8-47b2-9ae7-6db8b56d5324 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.193059] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-6b53b1d8-c2b8-47b2-9ae7-6db8b56d5324" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.193116] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-6b53b1d8-c2b8-47b2-9ae7-6db8b56d5324" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.193411] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-6b53b1d8-c2b8-47b2-9ae7-6db8b56d5324" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.193717] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b53b1d8-c2b8-47b2-9ae7-6db8b56d5324',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.262711] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.377531] env[66994]: INFO networking_nsxv3.common.synchronization [None req-d7629b66-33e4-41ad-84cd-dfbf8695da35 None None] Enqueued Resource ID: f8ef39a0-2182-4af5-872d-208e6a93e25d with Priority: HIGHEST for action port [ 721.378142] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8ef39a0-2182-4af5-872d-208e6a93e25d with Priority: HIGHEST for action port [ 721.378422] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8ef39a0-2182-4af5-872d-208e6a93e25d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.378486] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8ef39a0-2182-4af5-872d-208e6a93e25d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.378527] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8ef39a0-2182-4af5-872d-208e6a93e25d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.378986] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8ef39a0-2182-4af5-872d-208e6a93e25d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.378986] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8ef39a0-2182-4af5-872d-208e6a93e25d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.393392] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dec0b14a-938b-49d8-be95-1b62d57e23e2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.695583] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.695815] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.695981] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.696287] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.696430] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.696581] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 6b53b1d8-c2b8-47b2-9ae7-6db8b56d5324 not found, creating... [ 721.696839] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.696986] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.697115] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.697304] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.697505] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.697822] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.698025] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.698196] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.698407] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.698554] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.698664] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 6b53b1d8-c2b8-47b2-9ae7-6db8b56d5324 is going to be created. [ 721.720427] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.720640] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.720767] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.721057] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.721288] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.721543] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-6b53b1d8-c2b8-47b2-9ae7-6db8b56d5324" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.766517] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.881350] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8ef39a0-2182-4af5-872d-208e6a93e25d [ 721.882884] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.882884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.882884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.882884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.882884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.882884] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8ef39a0-2182-4af5-872d-208e6a93e25d already deleted. [ 721.882884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8ef39a0-2182-4af5-872d-208e6a93e25d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.899846] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.900020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.900101] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.900310] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.900417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.900545] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dec0b14a-938b-49d8-be95-1b62d57e23e2 is going to be created. [ 721.929548] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.929743] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.930270] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.930270] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.930270] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.942829] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dec0b14a-938b-49d8-be95-1b62d57e23e2 in Status: UNINITIALIZED for 2s [ 722.269860] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91e3865c-9322-423a-9d64-5c548ef52da8 in Status: SUCCESS [ 722.270231] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.270701] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.270929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.270929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.271260] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.271360] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.271486] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f is going to be updated. [ 722.310318] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.310434] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.310481] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.310727] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.310983] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.323821] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f in Status: IN_PROGRESS for 2s [ 722.521950] env[66994]: INFO networking_nsxv3.common.synchronization [req-71eca4c3-b903-42c5-93ab-d1613f539414 req-7308dc1d-c9f6-4528-8758-63d59002d9b7 service nova] Enqueued Resource ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f with Priority: HIGHEST for action security_group_rules [ 722.521950] env[66994]: INFO networking_nsxv3.common.synchronization [req-71eca4c3-b903-42c5-93ab-d1613f539414 req-7308dc1d-c9f6-4528-8758-63d59002d9b7 service nova] Enqueued Resource ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f with Priority: HIGHEST for action security_group_members [ 722.521950] env[66994]: INFO networking_nsxv3.common.synchronization [req-71eca4c3-b903-42c5-93ab-d1613f539414 req-7308dc1d-c9f6-4528-8758-63d59002d9b7 service nova] Enqueued Resource ID: 6b53b1d8-c2b8-47b2-9ae7-6db8b56d5324 with Priority: HIGHEST for action port [ 722.523094] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f with Priority: HIGHEST for action security_group_rules [ 722.523094] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f with Priority: HIGHEST for action security_group_members [ 722.523264] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b53b1d8-c2b8-47b2-9ae7-6db8b56d5324 with Priority: HIGHEST for action port [ 722.523412] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5a17dbe-38a0-49a6-88df-5879a5d5333f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.524408] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.524408] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.524408] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.524408] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.525989] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5a17dbe-38a0-49a6-88df-5879a5d5333f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.526105] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.526305] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b53b1d8-c2b8-47b2-9ae7-6db8b56d5324 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.526403] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b53b1d8-c2b8-47b2-9ae7-6db8b56d5324" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.526462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b53b1d8-c2b8-47b2-9ae7-6db8b56d5324" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.526686] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b53b1d8-c2b8-47b2-9ae7-6db8b56d5324" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.527546] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b53b1d8-c2b8-47b2-9ae7-6db8b56d5324',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.975520] env[66994]: INFO networking_nsxv3.common.synchronization [req-af7a031f-14a2-4ff1-812f-ce274dfbdd33 req-a2a716b6-5834-4c5c-be1b-c3faa0dd9ff1 tempest-ServersTestMultiNic-1223700725 tempest-ServersTestMultiNic-1223700725-project-member] Enqueued Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 722.977092] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 722.977459] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.977609] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.977670] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.977958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.978146] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.978247] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.978310] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.978485] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.978572] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.978670] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.026904] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5a17dbe-38a0-49a6-88df-5879a5d5333f taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.026904] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.032027] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b53b1d8-c2b8-47b2-9ae7-6db8b56d5324 with status ACTIVE [ 723.032027] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.032027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.032027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.032027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.032027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.032027] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.032027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.032027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.032027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.032027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.032027] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.032027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.032027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.032027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.032027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.032027] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b53b1d8-c2b8-47b2-9ae7-6db8b56d5324 is going to be updated. [ 723.061850] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.061850] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.061961] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.062160] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.062298] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.062466] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b53b1d8-c2b8-47b2-9ae7-6db8b56d5324" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.482075] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.482075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.482075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.482075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.482075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.482075] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.482075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.482075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.482720] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.482720] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.482720] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 already deleted. [ 723.482720] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.563317] env[66994]: INFO networking_nsxv3.common.synchronization [req-af7a031f-14a2-4ff1-812f-ce274dfbdd33 req-76d61606-fb94-4d5f-b307-f5c74dd53022 tempest-ServersTestMultiNic-1223700725 tempest-ServersTestMultiNic-1223700725-project-member] Enqueued Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 723.565679] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 723.565995] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.566146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.566220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.566433] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.566593] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.566692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.566756] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.566911] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.567044] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.567122] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.955339] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dec0b14a-938b-49d8-be95-1b62d57e23e2 in Status: SUCCESS [ 723.955569] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.955744] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.956110] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.956208] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.956324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.956391] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.956554] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.956637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.956724] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.956817] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dec0b14a-938b-49d8-be95-1b62d57e23e2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.014092] env[66994]: INFO networking_nsxv3.common.synchronization [req-af7a031f-14a2-4ff1-812f-ce274dfbdd33 req-17138120-2c53-4b5e-be6d-545c37683e97 tempest-ServersTestMultiNic-1223700725 tempest-ServersTestMultiNic-1223700725-project-member] Enqueued Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 724.015313] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 724.015579] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.015686] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.072559] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.072722] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.072804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.073054] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.073143] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.073343] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.073450] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.073515] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.073703] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.073790] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.073972] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 already deleted. [ 724.073972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.074140] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.074298] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.074433] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.074524] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.074579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.074767] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.074847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.074924] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.337769] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f in Status: SUCCESS [ 724.337769] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.337946] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.338530] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.338530] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.338680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.338730] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.338924] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.339016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.339148] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.389084] env[66994]: INFO networking_nsxv3.common.synchronization [None req-9ac3b733-9c8d-43ab-948d-f8892d5ef8d2 None None] Enqueued Resource ID: a5f9e3f4-5303-4177-90fa-5ac09469a072 with Priority: HIGHEST for action port [ 724.390423] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5f9e3f4-5303-4177-90fa-5ac09469a072 with Priority: HIGHEST for action port [ 724.390423] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5f9e3f4-5303-4177-90fa-5ac09469a072 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.392270] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5f9e3f4-5303-4177-90fa-5ac09469a072" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.392270] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5f9e3f4-5303-4177-90fa-5ac09469a072" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.392270] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5f9e3f4-5303-4177-90fa-5ac09469a072" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.392270] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5f9e3f4-5303-4177-90fa-5ac09469a072',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.460239] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-dec0b14a-938b-49d8-be95-1b62d57e23e2 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.460342] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.460342] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.462137] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.462137] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.462137] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.462137] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.462137] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.462137] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.462137] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.462137] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-dec0b14a-938b-49d8-be95-1b62d57e23e2 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.462137] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.462137] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.462137] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.462137] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.462137] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.462657] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.462657] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.462837] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.463310] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.463896] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dec0b14a-938b-49d8-be95-1b62d57e23e2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.554704] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.555138] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-860" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.555194] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-860" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.555604] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-860" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.555819] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.555988] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.556113] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.556329] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.556468] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.556666] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.556771] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 724.556922] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 724.556966] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 724.557077] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.557180] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 724.557306] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 724.578647] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.578947] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.579052] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.579358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.579445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.579689] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.579831] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.579922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.580159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.580264] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.580385] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 already deleted. [ 724.580497] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.583194] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 724.583501] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 724.584879] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 724.585105] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-860" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.585477] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-247d9090-be0f-429d-b1ea-2206e0b9984f taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.585677] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-247d9090-be0f-429d-b1ea-2206e0b9984f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.585813] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-247d9090-be0f-429d-b1ea-2206e0b9984f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.586222] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-247d9090-be0f-429d-b1ea-2206e0b9984f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.587647] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('247d9090-be0f-429d-b1ea-2206e0b9984f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.647971] env[66994]: INFO networking_nsxv3.common.synchronization [None req-c18c4fd4-55bd-4d70-bbb8-1964dd9b1078 tempest-ServersTestJSON-428956918 tempest-ServersTestJSON-428956918-project-member] Enqueued Resource ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 with Priority: HIGHEST for action security_group_rules [ 724.648579] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 with Priority: HIGHEST for action security_group_rules [ 724.654156] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34bde346-4da1-4dd8-ad15-cd1afe320304 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.654156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.654156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.654156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.654156] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34bde346-4da1-4dd8-ad15-cd1afe320304',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.790586] env[66994]: INFO networking_nsxv3.common.synchronization [None req-ed7b9429-8dcc-4f29-a2fd-28ae7a092a4d tempest-ServersTestJSON-428956918 tempest-ServersTestJSON-428956918-project-member] Enqueued Resource ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 with Priority: HIGHEST for action security_group_rules [ 724.791359] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 with Priority: HIGHEST for action security_group_rules [ 724.791708] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34bde346-4da1-4dd8-ad15-cd1afe320304 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.792687] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.842429] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.898572] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5f9e3f4-5303-4177-90fa-5ac09469a072 [ 724.898696] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.898759] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.898824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.899103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.899544] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.899544] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5f9e3f4-5303-4177-90fa-5ac09469a072 already deleted. [ 724.899544] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5f9e3f4-5303-4177-90fa-5ac09469a072" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.969324] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dec0b14a-938b-49d8-be95-1b62d57e23e2: rpc.has_security_group_logging(os_id): False [ 724.990150] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.990150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.990150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.990150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.990150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.990150] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.990150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.990150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.990150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.990150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.990549] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.990549] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.990549] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.990549] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.991323] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.991323] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.991323] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.991323] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.991323] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.991323] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.991323] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dec0b14a-938b-49d8-be95-1b62d57e23e2 is going to be created. [ 725.061015] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.061339] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.061339] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.061947] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.061947] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.075763] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dec0b14a-938b-49d8-be95-1b62d57e23e2 in Status: IN_PROGRESS for 2s [ 725.092019] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.092019] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.092019] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.092019] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.092019] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.092019] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 247d9090-be0f-429d-b1ea-2206e0b9984f not found, creating... [ 725.092019] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.092019] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.092019] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.092019] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.092019] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.092694] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.092694] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.092694] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.092694] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.092694] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.092694] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 247d9090-be0f-429d-b1ea-2206e0b9984f is going to be created. [ 725.118279] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.118279] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.118279] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.118279] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.118279] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.118826] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-247d9090-be0f-429d-b1ea-2206e0b9984f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.186466] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.186813] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.186813] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.187053] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.187151] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.187254] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 already deleted. [ 725.187338] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.187503] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.187668] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.187755] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34bde346-4da1-4dd8-ad15-cd1afe320304',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.346960] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.670306] env[66994]: INFO networking_nsxv3.common.synchronization [None req-441538ab-aa46-42a3-b001-b003d3c1a70b tempest-ImagesOneServerNegativeTestJSON-1432587522 tempest-ImagesOneServerNegativeTestJSON-1432587522-project-member] Enqueued Resource ID: 0935f5ee-3ab4-4168-afa7-00cfe0caee1d with Priority: HIGHEST for action security_group_rules [ 725.670915] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0935f5ee-3ab4-4168-afa7-00cfe0caee1d with Priority: HIGHEST for action security_group_rules [ 725.671225] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0935f5ee-3ab4-4168-afa7-00cfe0caee1d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.671373] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0935f5ee-3ab4-4168-afa7-00cfe0caee1d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.671521] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0935f5ee-3ab4-4168-afa7-00cfe0caee1d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.672861] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0935f5ee-3ab4-4168-afa7-00cfe0caee1d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.673375] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0935f5ee-3ab4-4168-afa7-00cfe0caee1d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.712913] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.713086] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.713132] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.713351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.713441] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.713536] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 already deleted. [ 725.713612] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.853027] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.853027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.853027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.853027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.853027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.853027] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f is going to be updated. [ 725.889959] env[66994]: INFO networking_nsxv3.common.synchronization [req-af7a031f-14a2-4ff1-812f-ce274dfbdd33 req-cea014d5-87f7-4deb-a879-b568b120437c service nova] Enqueued Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_rules [ 725.890166] env[66994]: INFO networking_nsxv3.common.synchronization [req-af7a031f-14a2-4ff1-812f-ce274dfbdd33 req-cea014d5-87f7-4deb-a879-b568b120437c service nova] Enqueued Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 725.890300] env[66994]: INFO networking_nsxv3.common.synchronization [req-af7a031f-14a2-4ff1-812f-ce274dfbdd33 req-cea014d5-87f7-4deb-a879-b568b120437c service nova] Enqueued Resource ID: 247d9090-be0f-429d-b1ea-2206e0b9984f with Priority: HIGHEST for action port [ 725.891093] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_rules [ 725.892561] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 725.892561] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 247d9090-be0f-429d-b1ea-2206e0b9984f with Priority: HIGHEST for action port [ 725.892561] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.892561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.892561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.892561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.892561] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.893641] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.893815] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.893895] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.894137] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.894326] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.894458] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.894540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.894742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.894857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.894988] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.896138] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-247d9090-be0f-429d-b1ea-2206e0b9984f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.896138] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-247d9090-be0f-429d-b1ea-2206e0b9984f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.896292] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-247d9090-be0f-429d-b1ea-2206e0b9984f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.896474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-247d9090-be0f-429d-b1ea-2206e0b9984f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.896567] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('247d9090-be0f-429d-b1ea-2206e0b9984f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.899077] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.899077] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.899077] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.899397] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.899397] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.914628] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f in Status: IN_PROGRESS for 2s [ 726.197695] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.197989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.198159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.198630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.200269] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.200867] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0935f5ee-3ab4-4168-afa7-00cfe0caee1d already deleted. [ 726.200867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0935f5ee-3ab4-4168-afa7-00cfe0caee1d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.211023] env[66994]: INFO networking_nsxv3.common.synchronization [None req-ac33cda7-eb5e-42db-ad2a-0571c7df1e5d tempest-ImagesOneServerNegativeTestJSON-1432587522 tempest-ImagesOneServerNegativeTestJSON-1432587522-project-member] Enqueued Resource ID: 0935f5ee-3ab4-4168-afa7-00cfe0caee1d with Priority: HIGHEST for action security_group_rules [ 726.211023] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0935f5ee-3ab4-4168-afa7-00cfe0caee1d with Priority: HIGHEST for action security_group_rules [ 726.211465] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0935f5ee-3ab4-4168-afa7-00cfe0caee1d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.211848] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0935f5ee-3ab4-4168-afa7-00cfe0caee1d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.212141] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0935f5ee-3ab4-4168-afa7-00cfe0caee1d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.212716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0935f5ee-3ab4-4168-afa7-00cfe0caee1d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.212886] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0935f5ee-3ab4-4168-afa7-00cfe0caee1d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.402462] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.403770] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.403899] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.404098] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 247d9090-be0f-429d-b1ea-2206e0b9984f with status ACTIVE [ 726.404315] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.404493] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.404550] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.405042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.405042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.405151] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.405271] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.405344] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.405571] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.405652] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.405897] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.406038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.406110] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.406300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.406383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.406501] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 247d9090-be0f-429d-b1ea-2206e0b9984f is going to be updated. [ 726.431448] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.431770] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.431770] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.432081] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.432322] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.432487] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-247d9090-be0f-429d-b1ea-2206e0b9984f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.636400] env[66994]: INFO networking_nsxv3.common.synchronization [req-75182de4-888c-4126-b1f1-0bb755590651 req-764ac3c6-3800-490c-8ac4-9cfcc52263ca tempest-ServerAddressesTestJSON-1610173527 tempest-ServerAddressesTestJSON-1610173527-project-member] Enqueued Resource ID: 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 with Priority: HIGHEST for action security_group_members [ 726.636987] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 with Priority: HIGHEST for action security_group_members [ 726.637324] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.637468] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.637542] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.637813] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.637987] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.640727] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.640840] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.641031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.641411] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.642130] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6baaaeee-6f37-42ba-b9d6-0bcd943f91e5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.737905] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.738304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.738304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.738461] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.738560] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.738662] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0935f5ee-3ab4-4168-afa7-00cfe0caee1d already deleted. [ 726.738751] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0935f5ee-3ab4-4168-afa7-00cfe0caee1d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.909419] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.090434] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dec0b14a-938b-49d8-be95-1b62d57e23e2 in Status: SUCCESS [ 727.090656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.116940] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-693 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.117146] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-693" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.117266] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-693" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.117615] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-693" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.117877] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.118217] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.118217] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.118370] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.118502] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.118704] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.118816] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 727.118919] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 727.119033] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 727.119146] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.119243] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 727.119376] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 727.138833] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 727.139025] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 727.139148] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 727.139337] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-693" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.139781] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-e688457a-3b25-4536-a2b6-32d2e5aaa06c taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.139986] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-e688457a-3b25-4536-a2b6-32d2e5aaa06c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.140203] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-e688457a-3b25-4536-a2b6-32d2e5aaa06c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.140543] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-e688457a-3b25-4536-a2b6-32d2e5aaa06c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.140678] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e688457a-3b25-4536-a2b6-32d2e5aaa06c',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.144633] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.144868] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.144926] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.145168] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.145262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.145461] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.145662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.145662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.145809] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.145857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.145968] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 already deleted. [ 727.146094] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.413275] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.413540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.413592] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.413852] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.413959] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.414084] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 is going to be created. [ 727.448840] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.448995] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.449972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.449972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.449972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.465712] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: UNINITIALIZED for 2s [ 727.643626] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.644621] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.644621] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.644621] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.644981] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.644981] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port e688457a-3b25-4536-a2b6-32d2e5aaa06c not found, creating... [ 727.645269] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.645439] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.645553] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.645808] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.645938] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.646449] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.646561] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.646668] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.646960] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.647117] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.647283] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: e688457a-3b25-4536-a2b6-32d2e5aaa06c is going to be created. [ 727.668310] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.668665] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.668665] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.668904] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.669141] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.669380] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-e688457a-3b25-4536-a2b6-32d2e5aaa06c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.925543] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f in Status: SUCCESS [ 727.925891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.929024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.929024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.929024] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.929024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.929024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.929024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.929024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.929024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.929024] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.205969] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-168 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.205969] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-168" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.206229] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-168" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.206413] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-168" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.206660] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.206808] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.206918] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.207173] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.207404] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.207684] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.207897] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.207982] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.208105] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.208235] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.208321] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.208472] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.230989] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.231240] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 728.231470] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.231733] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-168" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.232228] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-dc8b97f1-6298-4587-84c3-fee78f01d561 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.232607] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-dc8b97f1-6298-4587-84c3-fee78f01d561" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.232673] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-dc8b97f1-6298-4587-84c3-fee78f01d561" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.233126] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-dc8b97f1-6298-4587-84c3-fee78f01d561" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.233335] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc8b97f1-6298-4587-84c3-fee78f01d561',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.413064] env[66994]: INFO networking_nsxv3.common.synchronization [req-af7a031f-14a2-4ff1-812f-ce274dfbdd33 req-6a52f3d0-5fd6-434a-8b6d-17bbe4201447 service nova] Enqueued Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_rules [ 728.413064] env[66994]: INFO networking_nsxv3.common.synchronization [req-af7a031f-14a2-4ff1-812f-ce274dfbdd33 req-6a52f3d0-5fd6-434a-8b6d-17bbe4201447 service nova] Enqueued Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 728.413064] env[66994]: INFO networking_nsxv3.common.synchronization [req-af7a031f-14a2-4ff1-812f-ce274dfbdd33 req-6a52f3d0-5fd6-434a-8b6d-17bbe4201447 service nova] Enqueued Resource ID: e688457a-3b25-4536-a2b6-32d2e5aaa06c with Priority: HIGHEST for action port [ 728.413467] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_rules [ 728.413519] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 728.413635] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e688457a-3b25-4536-a2b6-32d2e5aaa06c with Priority: HIGHEST for action port [ 728.414260] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.414433] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.414863] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.414956] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.415211] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-e688457a-3b25-4536-a2b6-32d2e5aaa06c taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.415362] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e688457a-3b25-4536-a2b6-32d2e5aaa06c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.415492] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e688457a-3b25-4536-a2b6-32d2e5aaa06c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.415692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e688457a-3b25-4536-a2b6-32d2e5aaa06c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.415827] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e688457a-3b25-4536-a2b6-32d2e5aaa06c',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.430724] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5a17dbe-38a0-49a6-88df-5879a5d5333f taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.431417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.431417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.431417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.431688] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.431688] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.431862] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.432052] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.432189] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.432317] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.432490] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5a17dbe-38a0-49a6-88df-5879a5d5333f taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.432609] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.432693] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.432869] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.433054] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.433364] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.433792] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.433997] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.434145] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.434265] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.434385] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.514106] env[66994]: INFO networking_nsxv3.common.synchronization [None req-cf824d37-66ef-48cd-8fd1-725cb351e225 None None] Enqueued Resource ID: 6fa91c32-49ee-4de3-a2f2-a67087890459 with Priority: HIGHEST for action port [ 728.514554] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fa91c32-49ee-4de3-a2f2-a67087890459 with Priority: HIGHEST for action port [ 728.514889] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fa91c32-49ee-4de3-a2f2-a67087890459 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.515078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fa91c32-49ee-4de3-a2f2-a67087890459" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.515193] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fa91c32-49ee-4de3-a2f2-a67087890459" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.515494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fa91c32-49ee-4de3-a2f2-a67087890459" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.515643] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fa91c32-49ee-4de3-a2f2-a67087890459',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.736693] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.736945] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.737098] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.737409] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.737560] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.737720] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port dc8b97f1-6298-4587-84c3-fee78f01d561 not found, creating... [ 728.738024] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.738260] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.738320] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.738546] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.738674] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.738960] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.739129] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.739232] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.739650] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.739849] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.740085] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: dc8b97f1-6298-4587-84c3-fee78f01d561 is going to be created. [ 728.763914] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.764439] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.764639] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.765095] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.765389] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.765663] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-dc8b97f1-6298-4587-84c3-fee78f01d561" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.922023] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e688457a-3b25-4536-a2b6-32d2e5aaa06c with status ACTIVE [ 728.922023] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.922023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.922023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.922023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.922023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.922023] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.922023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.922023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.922023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.922023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.922023] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.922023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.922023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.922023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.922717] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.922717] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e688457a-3b25-4536-a2b6-32d2e5aaa06c is going to be updated. [ 728.938093] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5a17dbe-38a0-49a6-88df-5879a5d5333f: rpc.has_security_group_logging(os_id): False [ 728.957458] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.957642] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.957689] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.957914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.958094] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.958268] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e688457a-3b25-4536-a2b6-32d2e5aaa06c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.960582] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.960723] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.960793] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.960988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.961091] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.961273] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.961374] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.961439] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.961602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.961698] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.961903] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.962011] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.962074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.962246] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.962297] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.962490] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.962584] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.962646] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.962786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.962861] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.962945] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f is going to be updated. [ 729.017917] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6fa91c32-49ee-4de3-a2f2-a67087890459 [ 729.018171] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.018305] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.018369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.018579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.018669] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.018763] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6fa91c32-49ee-4de3-a2f2-a67087890459 already deleted. [ 729.018846] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fa91c32-49ee-4de3-a2f2-a67087890459" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.037485] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.037659] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.037703] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.037913] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.038075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.056802] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f in Status: IN_PROGRESS for 2s [ 729.477354] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: SUCCESS [ 729.477586] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.477761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.478191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.478269] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.478362] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.478415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.478603] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.478680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.478961] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.478961] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.479835] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.480110] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.480203] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.480309] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.480374] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.480530] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.480611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.480740] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.545219] env[66994]: INFO networking_nsxv3.common.synchronization [req-75182de4-888c-4126-b1f1-0bb755590651 req-2d371a45-fedc-4a3d-92b7-2aab23f3e8ac service nova] Enqueued Resource ID: 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 with Priority: HIGHEST for action security_group_rules [ 729.545377] env[66994]: INFO networking_nsxv3.common.synchronization [req-75182de4-888c-4126-b1f1-0bb755590651 req-2d371a45-fedc-4a3d-92b7-2aab23f3e8ac service nova] Enqueued Resource ID: 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 with Priority: HIGHEST for action security_group_members [ 729.545512] env[66994]: INFO networking_nsxv3.common.synchronization [req-75182de4-888c-4126-b1f1-0bb755590651 req-2d371a45-fedc-4a3d-92b7-2aab23f3e8ac service nova] Enqueued Resource ID: dc8b97f1-6298-4587-84c3-fee78f01d561 with Priority: HIGHEST for action port [ 729.546289] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 with Priority: HIGHEST for action security_group_rules [ 729.546433] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 with Priority: HIGHEST for action security_group_members [ 729.546528] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8b97f1-6298-4587-84c3-fee78f01d561 with Priority: HIGHEST for action port [ 729.547331] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.547331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.547331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.547331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.547331] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6baaaeee-6f37-42ba-b9d6-0bcd943f91e5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.548215] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.549887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.549887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.551915] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.552237] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.552408] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.552480] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.552870] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.552969] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.553159] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6baaaeee-6f37-42ba-b9d6-0bcd943f91e5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.554550] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc8b97f1-6298-4587-84c3-fee78f01d561 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.554550] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc8b97f1-6298-4587-84c3-fee78f01d561" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.554640] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc8b97f1-6298-4587-84c3-fee78f01d561" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.555388] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc8b97f1-6298-4587-84c3-fee78f01d561" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.555388] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc8b97f1-6298-4587-84c3-fee78f01d561',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.986581] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.988098] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.988098] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.001032] env[66994]: INFO networking_nsxv3.common.synchronization [req-7c4e244e-7397-4d83-bda6-09f70933c836 req-15434245-d423-437f-b65a-96f8e3b15e84 tempest-InstanceActionsTestJSON-365549542 tempest-InstanceActionsTestJSON-365549542-project-member] Enqueued Resource ID: cda947aa-81ac-4826-ab42-0806fdd02361 with Priority: HIGHEST for action security_group_members [ 730.001032] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cda947aa-81ac-4826-ab42-0806fdd02361 with Priority: HIGHEST for action security_group_members [ 730.001032] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-cda947aa-81ac-4826-ab42-0806fdd02361 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.002533] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.002533] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.002533] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.002533] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.003156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.003156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.003156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.003156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.003156] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cda947aa-81ac-4826-ab42-0806fdd02361',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.059250] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6baaaeee-6f37-42ba-b9d6-0bcd943f91e5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.059250] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.059250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.059250] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc8b97f1-6298-4587-84c3-fee78f01d561 with status ACTIVE [ 730.059250] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.059250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.059250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.059250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.059250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.059777] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.059777] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.059777] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.059777] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.059777] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.060061] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.060649] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.060747] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.060881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.060956] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.061054] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc8b97f1-6298-4587-84c3-fee78f01d561 is going to be updated. [ 730.088454] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.088788] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.088903] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.089267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.089459] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.089706] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc8b97f1-6298-4587-84c3-fee78f01d561" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.126702] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.127430] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-860" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.127430] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-860" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.128195] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-860" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.128588] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.128938] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.129694] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.130090] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.130244] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.131705] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 730.131705] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 730.131705] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 730.131705] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 730.131705] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 730.131705] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 730.131705] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 730.159172] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 730.159401] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 730.159576] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 730.159752] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-860" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.160701] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-d6723324-80ce-4796-9113-56e45f9ae7ff taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.160701] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-d6723324-80ce-4796-9113-56e45f9ae7ff" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.160701] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-d6723324-80ce-4796-9113-56e45f9ae7ff" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.160988] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-d6723324-80ce-4796-9113-56e45f9ae7ff" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.162113] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6723324-80ce-4796-9113-56e45f9ae7ff',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.489618] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.506539] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.507417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.507417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.507417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.507417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.507569] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.507668] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.507758] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.508011] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.508940] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.508940] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cda947aa-81ac-4826-ab42-0806fdd02361 is going to be updated. [ 730.535954] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.535954] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.535954] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.536132] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.536306] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.549606] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cda947aa-81ac-4826-ab42-0806fdd02361 in Status: IN_PROGRESS for 2s [ 730.563432] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6baaaeee-6f37-42ba-b9d6-0bcd943f91e5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.667184] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.667463] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.667646] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.667947] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.669035] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.669035] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port d6723324-80ce-4796-9113-56e45f9ae7ff not found, creating... [ 730.669520] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.669520] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.669520] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.669792] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.669958] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.670305] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.670489] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.670586] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.670812] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.671014] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.671347] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: d6723324-80ce-4796-9113-56e45f9ae7ff is going to be created. [ 730.692121] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.692475] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.692475] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.693620] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.693620] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.693620] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-d6723324-80ce-4796-9113-56e45f9ae7ff" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.972578] env[66994]: INFO networking_nsxv3.common.synchronization [None req-4a1f30b3-21ec-43fd-bae0-6c48f8ad9f0c None None] Enqueued Resource ID: 50a413ea-bae3-46df-9ea4-40c81a3f3337 with Priority: HIGHEST for action port [ 730.973117] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a413ea-bae3-46df-9ea4-40c81a3f3337 with Priority: HIGHEST for action port [ 730.973500] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-50a413ea-bae3-46df-9ea4-40c81a3f3337 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.973643] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50a413ea-bae3-46df-9ea4-40c81a3f3337" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.973759] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50a413ea-bae3-46df-9ea4-40c81a3f3337" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.975118] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50a413ea-bae3-46df-9ea4-40c81a3f3337" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.975550] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50a413ea-bae3-46df-9ea4-40c81a3f3337',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.991592] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.991932] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.991932] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.992139] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.992255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.992360] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 is going to be updated. [ 731.024043] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.024243] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.024384] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.024665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.024957] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.034467] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: IN_PROGRESS for 2s [ 731.066212] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.066340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.066340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.067445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.067445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.067445] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 is going to be created. [ 731.070910] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f in Status: SUCCESS [ 731.071161] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.089991] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.090694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.090796] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.091031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.091197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.103032] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 in Status: UNINITIALIZED for 2s [ 731.444016] env[66994]: INFO networking_nsxv3.common.synchronization [req-af7a031f-14a2-4ff1-812f-ce274dfbdd33 req-c4842444-27a4-4991-a02e-874ccd4c064e service nova] Enqueued Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_rules [ 731.444016] env[66994]: INFO networking_nsxv3.common.synchronization [req-af7a031f-14a2-4ff1-812f-ce274dfbdd33 req-c4842444-27a4-4991-a02e-874ccd4c064e service nova] Enqueued Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 731.444187] env[66994]: INFO networking_nsxv3.common.synchronization [req-af7a031f-14a2-4ff1-812f-ce274dfbdd33 req-c4842444-27a4-4991-a02e-874ccd4c064e service nova] Enqueued Resource ID: d6723324-80ce-4796-9113-56e45f9ae7ff with Priority: HIGHEST for action port [ 731.444719] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_rules [ 731.444875] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 731.444973] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6723324-80ce-4796-9113-56e45f9ae7ff with Priority: HIGHEST for action port [ 731.445714] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.445884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.446246] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.446246] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.446354] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6723324-80ce-4796-9113-56e45f9ae7ff taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.446497] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6723324-80ce-4796-9113-56e45f9ae7ff" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.446497] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6723324-80ce-4796-9113-56e45f9ae7ff" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.446665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6723324-80ce-4796-9113-56e45f9ae7ff" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.446744] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6723324-80ce-4796-9113-56e45f9ae7ff',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.477681] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50a413ea-bae3-46df-9ea4-40c81a3f3337 [ 731.477915] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.478067] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.478124] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.478565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.478565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.478565] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50a413ea-bae3-46df-9ea4-40c81a3f3337 already deleted. [ 731.478936] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50a413ea-bae3-46df-9ea4-40c81a3f3337" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.949920] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6723324-80ce-4796-9113-56e45f9ae7ff with status ACTIVE [ 731.950204] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.950346] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.950417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.950848] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.950848] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.950933] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.951050] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.951156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.951270] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.951343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.952794] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.952962] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.953055] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.953295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.953381] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.953475] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6723324-80ce-4796-9113-56e45f9ae7ff is going to be updated. [ 731.980228] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.980388] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.980450] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.980639] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.980931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.981047] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6723324-80ce-4796-9113-56e45f9ae7ff" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.559733] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cda947aa-81ac-4826-ab42-0806fdd02361 in Status: SUCCESS [ 732.560084] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cda947aa-81ac-4826-ab42-0806fdd02361 deletion is rescheduled due to dependency. [ 732.560084] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.049051] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: SUCCESS [ 733.049051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.049051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.049051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.049051] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.049051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.049051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.049051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.049051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.049051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.049051] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.049051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.049051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.049051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.049051] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.049627] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.049627] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.049627] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.049627] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.049627] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.049627] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.050615] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.050937] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.051108] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.051267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.051314] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.052816] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.052816] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.052816] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.115408] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 in Status: SUCCESS [ 733.115653] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.115830] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.116110] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.116351] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.116429] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.116562] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.116714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.116763] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.116934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.116934] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6baaaeee-6f37-42ba-b9d6-0bcd943f91e5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.235706] env[66994]: INFO networking_nsxv3.common.synchronization [None req-0e415694-f146-4a97-a4ea-7efc5689b4d1 None None] Enqueued Resource ID: 35d2faf1-6088-49b6-828a-e65d2004bc0f with Priority: HIGHEST for action port [ 733.236380] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35d2faf1-6088-49b6-828a-e65d2004bc0f with Priority: HIGHEST for action port [ 733.237453] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-35d2faf1-6088-49b6-828a-e65d2004bc0f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.237453] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35d2faf1-6088-49b6-828a-e65d2004bc0f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.237453] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35d2faf1-6088-49b6-828a-e65d2004bc0f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.237453] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35d2faf1-6088-49b6-828a-e65d2004bc0f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.237453] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35d2faf1-6088-49b6-828a-e65d2004bc0f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.553814] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9108b2cc-cd11-4784-9282-52da311e05f1: rpc.has_security_group_logging(os_id): False [ 733.556551] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.573618] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.574134] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.574134] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.574359] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.574565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.575718] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.575833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.575925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.576301] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.576513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.576867] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.576867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.577017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.577293] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.577410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.577638] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.577833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.577934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.578134] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.578198] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.578853] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 is going to be created. [ 733.621856] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.622765] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.622946] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.623222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.623424] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.623586] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.623618] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.623810] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.623905] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.623999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.624168] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.624262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.624324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.624465] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.624604] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.624693] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.624751] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.624886] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.624960] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.625075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.625168] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6baaaeee-6f37-42ba-b9d6-0bcd943f91e5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.641442] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.641626] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.641671] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.641866] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.642065] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.654495] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: IN_PROGRESS for 2s [ 733.741764] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35d2faf1-6088-49b6-828a-e65d2004bc0f [ 733.741764] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.741764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.742187] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.742454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.742543] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.742640] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35d2faf1-6088-49b6-828a-e65d2004bc0f already deleted. [ 733.742729] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35d2faf1-6088-49b6-828a-e65d2004bc0f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.974429] env[66994]: INFO networking_nsxv3.common.synchronization [None req-6573ebb3-4f39-4429-ba33-dd303b5e4242 None None] Enqueued Resource ID: 68f5568e-0621-4839-bb30-21e700a176a5 with Priority: HIGHEST for action port [ 733.974961] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68f5568e-0621-4839-bb30-21e700a176a5 with Priority: HIGHEST for action port [ 733.975265] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-68f5568e-0621-4839-bb30-21e700a176a5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.975461] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68f5568e-0621-4839-bb30-21e700a176a5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.975461] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68f5568e-0621-4839-bb30-21e700a176a5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.975735] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68f5568e-0621-4839-bb30-21e700a176a5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.975812] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68f5568e-0621-4839-bb30-21e700a176a5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.060101] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.128547] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5: rpc.has_security_group_logging(os_id): False [ 734.148355] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.148582] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.148582] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.148891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.149028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.149134] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.149231] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.149294] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.149444] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.149519] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.149713] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.149805] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.149850] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.150408] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.150408] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.150408] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.150408] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.150580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.150626] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.150701] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.150768] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 is going to be created. [ 734.217855] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.217855] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.217855] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.219009] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.219009] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.232283] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 in Status: IN_PROGRESS for 2s [ 734.477556] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68f5568e-0621-4839-bb30-21e700a176a5 [ 734.477803] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.477942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.478018] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.478261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.478351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.478446] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68f5568e-0621-4839-bb30-21e700a176a5 already deleted. [ 734.478528] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68f5568e-0621-4839-bb30-21e700a176a5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.566815] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.570952] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.570952] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.570952] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.570952] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.570952] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 is going to be updated. [ 734.602584] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.602584] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.602584] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.602584] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.602584] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.612832] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: IN_PROGRESS for 2s [ 735.670474] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: SUCCESS [ 735.670858] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.670934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.671259] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.671259] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.030023] env[66994]: INFO networking_nsxv3.common.synchronization [req-5d448fa1-02a0-4b32-91b0-9b3190c52167 req-cbdc5514-1eec-414f-830c-0d5605e2ffc5 tempest-ServerActionsTestOtherB-1891732265 tempest-ServerActionsTestOtherB-1891732265-project-member] Enqueued Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_members [ 736.030023] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_members [ 736.030023] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.032461] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.032683] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.033118] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.033397] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.037024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.037024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.037024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.037024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.037024] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.173733] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.175476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.247151] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 in Status: SUCCESS [ 736.247274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.374383] env[66994]: INFO networking_nsxv3.common.synchronization [None req-b46e2c24-9525-49a2-a3e8-34856b809f25 None None] Enqueued Resource ID: 025ea639-98d0-4519-b568-e59627aaf1e0 with Priority: HIGHEST for action port [ 736.375052] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025ea639-98d0-4519-b568-e59627aaf1e0 with Priority: HIGHEST for action port [ 736.376139] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-025ea639-98d0-4519-b568-e59627aaf1e0 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.376322] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-025ea639-98d0-4519-b568-e59627aaf1e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.376635] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-025ea639-98d0-4519-b568-e59627aaf1e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.376966] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-025ea639-98d0-4519-b568-e59627aaf1e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.377062] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('025ea639-98d0-4519-b568-e59627aaf1e0',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.539375] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.539538] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.539601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.539827] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.539928] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.540148] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.540235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.540285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.540437] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.540505] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.540637] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e already deleted. [ 736.540682] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.625689] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: SUCCESS [ 736.626236] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.626236] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.626527] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.626790] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.627794] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.627844] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.628033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.628325] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.628431] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.628513] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.795042] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-729 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.795577] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-729" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.795577] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-729" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.797047] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-729" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.798261] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.798462] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.798573] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.798786] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.798933] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.799165] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 736.799274] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 736.799375] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 736.799607] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 736.799607] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 736.799744] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 736.799887] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 736.821621] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 736.822024] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 736.822289] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 736.822429] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-729" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.822750] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-e01155a7-9958-4b8e-9736-750c407123cf taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.822928] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-e01155a7-9958-4b8e-9736-750c407123cf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.823206] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-e01155a7-9958-4b8e-9736-750c407123cf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.823602] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-e01155a7-9958-4b8e-9736-750c407123cf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.823738] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e01155a7-9958-4b8e-9736-750c407123cf',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.878814] env[66994]: INFO networking_nsxv3.common.synchronization [None req-9cdecf79-d77c-48b4-abef-ccb011e322db None None] Enqueued Resource ID: ba6f78e6-da72-475f-8a4f-c7ddfccc0e59 with Priority: HIGHEST for action port [ 736.879412] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba6f78e6-da72-475f-8a4f-c7ddfccc0e59 with Priority: HIGHEST for action port [ 736.879746] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba6f78e6-da72-475f-8a4f-c7ddfccc0e59 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.879881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba6f78e6-da72-475f-8a4f-c7ddfccc0e59" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.879970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba6f78e6-da72-475f-8a4f-c7ddfccc0e59" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.880286] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba6f78e6-da72-475f-8a4f-c7ddfccc0e59" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.880393] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba6f78e6-da72-475f-8a4f-c7ddfccc0e59',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.881159] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 025ea639-98d0-4519-b568-e59627aaf1e0 [ 736.881395] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.882337] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.882337] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.882337] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.882337] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.882337] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:025ea639-98d0-4519-b568-e59627aaf1e0 already deleted. [ 736.882337] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-025ea639-98d0-4519-b568-e59627aaf1e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.132259] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.132259] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.132259] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.132259] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.132259] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.132259] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.132259] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.132259] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.132259] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.132784] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.132784] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.132784] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.132784] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.132784] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.132949] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.132949] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.133034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.133225] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.133340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.133390] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.133480] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.327880] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.330180] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.330180] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.330180] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.330180] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.330180] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port e01155a7-9958-4b8e-9736-750c407123cf not found, creating... [ 737.330180] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.330180] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.330180] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.330180] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.330180] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.331065] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.333684] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.333987] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.334184] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.335640] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.335640] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: e01155a7-9958-4b8e-9736-750c407123cf is going to be created. [ 737.358575] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.358814] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.358941] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.359325] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.359589] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.359868] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-e01155a7-9958-4b8e-9736-750c407123cf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.383868] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba6f78e6-da72-475f-8a4f-c7ddfccc0e59 [ 737.383868] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.383868] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.383868] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.383868] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.383868] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.383868] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba6f78e6-da72-475f-8a4f-c7ddfccc0e59 already deleted. [ 737.383868] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba6f78e6-da72-475f-8a4f-c7ddfccc0e59" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.635411] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9108b2cc-cd11-4784-9282-52da311e05f1: rpc.has_security_group_logging(os_id): False [ 737.658060] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.658221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.658285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.658493] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.658588] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.658778] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.658878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.658936] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.659102] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.659180] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.659372] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.659465] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.659526] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.659666] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.659746] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.659917] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.660016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.660077] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.660212] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.660284] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.660368] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 is going to be updated. [ 737.726705] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.726705] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.726705] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.726705] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.726705] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.739518] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: IN_PROGRESS for 2s [ 738.091638] env[66994]: INFO networking_nsxv3.common.synchronization [req-5d448fa1-02a0-4b32-91b0-9b3190c52167 req-993e8cbb-1b1c-4634-aaeb-ca5e6588a2dc service nova] Enqueued Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_rules [ 738.091936] env[66994]: INFO networking_nsxv3.common.synchronization [req-5d448fa1-02a0-4b32-91b0-9b3190c52167 req-993e8cbb-1b1c-4634-aaeb-ca5e6588a2dc service nova] Enqueued Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_members [ 738.091936] env[66994]: INFO networking_nsxv3.common.synchronization [req-5d448fa1-02a0-4b32-91b0-9b3190c52167 req-993e8cbb-1b1c-4634-aaeb-ca5e6588a2dc service nova] Enqueued Resource ID: e01155a7-9958-4b8e-9736-750c407123cf with Priority: HIGHEST for action port [ 738.092494] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_rules [ 738.092666] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_members [ 738.092777] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e01155a7-9958-4b8e-9736-750c407123cf with Priority: HIGHEST for action port [ 738.093599] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.093716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.093857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.093971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.101191] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.101191] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.101191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.101191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.101191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.101191] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.101191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.101191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.101191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.101191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.101191] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.105350] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-e01155a7-9958-4b8e-9736-750c407123cf taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.105510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e01155a7-9958-4b8e-9736-750c407123cf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.105561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e01155a7-9958-4b8e-9736-750c407123cf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.105816] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e01155a7-9958-4b8e-9736-750c407123cf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.105875] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e01155a7-9958-4b8e-9736-750c407123cf',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.608671] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.608861] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.608986] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.609919] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e01155a7-9958-4b8e-9736-750c407123cf with status ACTIVE [ 738.610164] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.610281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.610348] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.610548] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.610663] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.612445] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.612445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.612445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.612445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.612445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.612445] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.612445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.612445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.612445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.612445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.612445] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e01155a7-9958-4b8e-9736-750c407123cf is going to be updated. [ 738.637400] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.637718] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.637718] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.637806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.638342] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.638342] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e01155a7-9958-4b8e-9736-750c407123cf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.692916] env[66994]: INFO networking_nsxv3.common.synchronization [req-51ef24db-ef0b-46f6-83de-56d8391dc3f8 req-d40795b8-7310-4220-9103-2642805af70b tempest-MigrationsAdminTest-2127426748 tempest-MigrationsAdminTest-2127426748-project-member] Enqueued Resource ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d with Priority: HIGHEST for action security_group_members [ 738.693605] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d with Priority: HIGHEST for action security_group_members [ 738.694019] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.694165] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.694592] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.694592] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.694662] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.694718] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.694828] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.694963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.695076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.695336] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.116593] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.198283] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.198441] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.198531] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.198747] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.198845] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.199069] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.199167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.199237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.199378] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.199452] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.199536] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d already deleted. [ 739.199615] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.418079] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.418079] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.418079] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.418079] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.418079] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.418079] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.418079] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.418079] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.420421] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.420542] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.420638] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 739.420747] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 739.420852] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 739.420959] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.421074] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 739.421199] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 739.440958] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 739.441172] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 739.441344] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 739.441495] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.442320] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-669c5ee9-fed4-417a-a076-6fa23debcaf8 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.442494] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-669c5ee9-fed4-417a-a076-6fa23debcaf8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.442952] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-669c5ee9-fed4-417a-a076-6fa23debcaf8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.442952] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-669c5ee9-fed4-417a-a076-6fa23debcaf8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.443095] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('669c5ee9-fed4-417a-a076-6fa23debcaf8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.618766] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.619192] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.619363] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.619682] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.619941] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.620862] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e is going to be created. [ 739.643157] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.643329] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.643370] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.643570] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.643730] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.653152] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: UNINITIALIZED for 2s [ 739.754815] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: SUCCESS [ 739.755174] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.755487] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.755613] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.755704] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.947584] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.947584] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.947584] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.947794] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.947929] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.948090] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 669c5ee9-fed4-417a-a076-6fa23debcaf8 not found, creating... [ 739.948354] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.948643] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.948710] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.948900] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.949043] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.949319] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.949467] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.949575] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.949770] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.949895] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.950040] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 669c5ee9-fed4-417a-a076-6fa23debcaf8 is going to be created. [ 739.972889] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.972889] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.973023] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.973271] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.973495] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.973717] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-669c5ee9-fed4-417a-a076-6fa23debcaf8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.258849] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.259418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.259418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.259418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.259602] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.259602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.259780] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.259866] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.260019] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.260073] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.260172] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.732536] env[66994]: INFO networking_nsxv3.common.synchronization [req-51ef24db-ef0b-46f6-83de-56d8391dc3f8 req-5c266823-5a3b-451a-83ff-4fd84c3703a4 service nova] Enqueued Resource ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d with Priority: HIGHEST for action security_group_rules [ 740.732785] env[66994]: INFO networking_nsxv3.common.synchronization [req-51ef24db-ef0b-46f6-83de-56d8391dc3f8 req-5c266823-5a3b-451a-83ff-4fd84c3703a4 service nova] Enqueued Resource ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d with Priority: HIGHEST for action security_group_members [ 740.732952] env[66994]: INFO networking_nsxv3.common.synchronization [req-51ef24db-ef0b-46f6-83de-56d8391dc3f8 req-5c266823-5a3b-451a-83ff-4fd84c3703a4 service nova] Enqueued Resource ID: 669c5ee9-fed4-417a-a076-6fa23debcaf8 with Priority: HIGHEST for action port [ 740.737510] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d with Priority: HIGHEST for action security_group_rules [ 740.737722] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d with Priority: HIGHEST for action security_group_members [ 740.737883] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 669c5ee9-fed4-417a-a076-6fa23debcaf8 with Priority: HIGHEST for action port [ 740.738329] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc9a0c95-f9f4-4eb7-a275-05d69816e71d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.738496] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.738587] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.738870] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.738976] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.740021] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.744276] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.744444] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.745077] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.745077] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.745077] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.745235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.745289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.745357] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.745453] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.746813] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-669c5ee9-fed4-417a-a076-6fa23debcaf8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.746813] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-669c5ee9-fed4-417a-a076-6fa23debcaf8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.746936] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-669c5ee9-fed4-417a-a076-6fa23debcaf8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.747136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-669c5ee9-fed4-417a-a076-6fa23debcaf8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.747281] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('669c5ee9-fed4-417a-a076-6fa23debcaf8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.763050] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.764042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.764042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.764042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.764042] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.766035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.766035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.766035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.766035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.766035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.766035] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.766035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.766035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.766035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.766035] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.766035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.766035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.766035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.766516] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.766516] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.766516] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.250587] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.251858] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.252056] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.252507] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 669c5ee9-fed4-417a-a076-6fa23debcaf8 with status ACTIVE [ 741.252707] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.252851] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.252959] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.253190] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.253305] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.253509] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.253655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.253741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.253953] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.254089] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.254405] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.254601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.254689] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.254871] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.254985] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.255112] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 669c5ee9-fed4-417a-a076-6fa23debcaf8 is going to be updated. [ 741.269654] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9108b2cc-cd11-4784-9282-52da311e05f1: rpc.has_security_group_logging(os_id): False [ 741.280781] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.280977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.280977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.281513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.281513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.281513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-669c5ee9-fed4-417a-a076-6fa23debcaf8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.289767] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.290141] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.290220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.290432] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.290528] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.290736] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.292333] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.292594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.292844] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.292953] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.293277] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.293389] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.293455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.293666] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.293723] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.294722] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.294903] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.295051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.295838] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.296077] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.296410] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 is going to be updated. [ 741.377848] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.378182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.378182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.378335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.378501] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.399487] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: IN_PROGRESS for 2s [ 741.665114] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: SUCCESS [ 741.665114] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.665114] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.665394] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.666267] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.666267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.666505] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.666598] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.666715] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.666833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.666960] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.753942] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.886316] env[66994]: INFO networking_nsxv3.common.synchronization [None req-095a8ee0-0efe-407d-a921-a68d1f65b2b2 None None] Enqueued Resource ID: 44e1ccd0-6b99-4394-8bfb-b8da713b5085 with Priority: HIGHEST for action port [ 741.887164] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44e1ccd0-6b99-4394-8bfb-b8da713b5085 with Priority: HIGHEST for action port [ 741.887479] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-44e1ccd0-6b99-4394-8bfb-b8da713b5085 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.887602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44e1ccd0-6b99-4394-8bfb-b8da713b5085" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.887661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44e1ccd0-6b99-4394-8bfb-b8da713b5085" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.887928] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44e1ccd0-6b99-4394-8bfb-b8da713b5085" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.889112] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44e1ccd0-6b99-4394-8bfb-b8da713b5085',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.058944] env[66994]: INFO networking_nsxv3.common.synchronization [None req-7d1c3e99-f5ef-4e0a-b2ff-0af9099a697f tempest-ServersTestManualDisk-463487739 tempest-ServersTestManualDisk-463487739-project-member] Enqueued Resource ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e with Priority: HIGHEST for action security_group_rules [ 742.058944] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e with Priority: HIGHEST for action security_group_rules [ 742.058944] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.058944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.059129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.062899] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.062899] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7c25236-fc58-43cd-bd73-8bca62dfbd5e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.169146] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.256523] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.256675] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.256745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.257132] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.257132] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.257132] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d is going to be created. [ 742.285589] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.285998] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.285998] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.286790] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.286790] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.298777] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d in Status: UNINITIALIZED for 2s [ 742.306820] env[66994]: INFO networking_nsxv3.common.synchronization [None req-0b584479-d536-4764-a9ae-5bf2f70350db tempest-ServersTestManualDisk-463487739 tempest-ServersTestManualDisk-463487739-project-member] Enqueued Resource ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e with Priority: HIGHEST for action security_group_rules [ 742.307710] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e with Priority: HIGHEST for action security_group_rules [ 742.308222] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.308222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.392456] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44e1ccd0-6b99-4394-8bfb-b8da713b5085 [ 742.392821] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.393043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.393176] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.393491] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.393655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.393790] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44e1ccd0-6b99-4394-8bfb-b8da713b5085 already deleted. [ 742.393984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44e1ccd0-6b99-4394-8bfb-b8da713b5085" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.434972] env[66994]: INFO networking_nsxv3.common.synchronization [req-c9990269-893f-4b6b-96e9-c29550afe503 req-d8d0b3e8-d42b-4641-819f-9eea115a0d4a tempest-SecurityGroupRulesNegativeTestJSON-393875186 tempest-SecurityGroupRulesNegativeTestJSON-393875186-project-member] Enqueued Resource ID: dd48b835-f116-4006-a276-44a93783c6bb with Priority: HIGHEST for action security_group_rules [ 742.436052] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd48b835-f116-4006-a276-44a93783c6bb with Priority: HIGHEST for action security_group_rules [ 742.436442] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd48b835-f116-4006-a276-44a93783c6bb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.436704] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd48b835-f116-4006-a276-44a93783c6bb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.436704] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd48b835-f116-4006-a276-44a93783c6bb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.436895] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd48b835-f116-4006-a276-44a93783c6bb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.436977] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd48b835-f116-4006-a276-44a93783c6bb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.585698] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.586011] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.586157] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.586455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.586616] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.586758] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e already deleted. [ 742.586886] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.587068] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.587260] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.587360] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7c25236-fc58-43cd-bd73-8bca62dfbd5e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.671510] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24a08da7-cf3b-41d4-b7f4-8e3b7616589e: rpc.has_security_group_logging(os_id): False [ 742.694058] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.694282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.694458] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.694713] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.694887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.695284] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.695435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.695532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.696161] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.696161] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.697629] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e is going to be created. [ 742.791742] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.791918] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.792013] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.792251] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.792444] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.819844] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: IN_PROGRESS for 2s [ 742.964907] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.965093] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.965189] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.965415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.965508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.965606] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd48b835-f116-4006-a276-44a93783c6bb already deleted. [ 742.965685] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd48b835-f116-4006-a276-44a93783c6bb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.110273] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.110461] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.110461] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.110822] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.110822] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.110822] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e already deleted. [ 743.111068] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.417620] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: SUCCESS [ 743.418058] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.507700] env[66994]: INFO networking_nsxv3.common.synchronization [req-9a3bd7f0-cf62-485f-a91f-d3a12fdfea29 req-2b33d47f-f687-4c69-ba4f-039a510d26c4 tempest-ServersTestJSON-587851554 tempest-ServersTestJSON-587851554-project-member] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 743.509177] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 743.509659] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.509791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.509855] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.510091] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.510253] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.510353] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.510425] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.510571] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.510655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.510750] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.013179] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.105099] env[66994]: INFO networking_nsxv3.common.synchronization [req-19e15654-4103-4e6d-a867-40a5152075ed req-0b23bd75-e174-43ec-a198-c3e9f74ce596 tempest-ServersAdminNegativeTestJSON-2113491752 tempest-ServersAdminNegativeTestJSON-2113491752-project-member] Enqueued Resource ID: 91e3865c-9322-423a-9d64-5c548ef52da8 with Priority: HIGHEST for action security_group_members [ 744.106920] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91e3865c-9322-423a-9d64-5c548ef52da8 with Priority: HIGHEST for action security_group_members [ 744.107297] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-91e3865c-9322-423a-9d64-5c548ef52da8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.107498] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.107622] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.107888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.108272] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.108272] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.108272] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.108663] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.108663] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.108663] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91e3865c-9322-423a-9d64-5c548ef52da8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.160198] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.160377] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.160491] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.160763] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.161037] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.161196] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.161335] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.161580] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.161746] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.161966] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.162251] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 744.162251] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 744.162366] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 744.162402] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.163028] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 744.163028] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 744.184632] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 744.186045] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 744.186045] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 744.186045] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.186045] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-c23f611f-cf67-43b1-b9f8-2ffafacf7697 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.186439] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-c23f611f-cf67-43b1-b9f8-2ffafacf7697" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.186439] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-c23f611f-cf67-43b1-b9f8-2ffafacf7697" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.186613] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-c23f611f-cf67-43b1-b9f8-2ffafacf7697" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.187241] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c23f611f-cf67-43b1-b9f8-2ffafacf7697',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.310408] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d in Status: SUCCESS [ 744.310669] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.310794] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.311031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.311246] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.311406] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.311406] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.311932] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.311932] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.311932] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.312349] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.517275] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.611367] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.611528] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.611602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.611816] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.611914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.612125] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.612232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.612302] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.612478] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.612555] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.612644] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91e3865c-9322-423a-9d64-5c548ef52da8 is going to be updated. [ 744.619285] env[66994]: INFO networking_nsxv3.common.synchronization [None req-c0f33830-b670-4328-9c5b-87fe4d669a5c None None] Enqueued Resource ID: a438192e-41a1-4626-a0cd-45536ab2845a with Priority: HIGHEST for action port [ 744.619544] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a438192e-41a1-4626-a0cd-45536ab2845a with Priority: HIGHEST for action port [ 744.620109] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-a438192e-41a1-4626-a0cd-45536ab2845a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.620388] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a438192e-41a1-4626-a0cd-45536ab2845a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.620388] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a438192e-41a1-4626-a0cd-45536ab2845a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.620532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a438192e-41a1-4626-a0cd-45536ab2845a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.620619] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a438192e-41a1-4626-a0cd-45536ab2845a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.641430] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.641608] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.641608] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.641851] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.642144] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.652244] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91e3865c-9322-423a-9d64-5c548ef52da8 in Status: IN_PROGRESS for 2s [ 744.689479] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.689704] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.689825] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.690153] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.690308] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.690465] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port c23f611f-cf67-43b1-b9f8-2ffafacf7697 not found, creating... [ 744.690720] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.691460] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.691460] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.691460] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.691460] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.691699] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.691857] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.691977] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.692230] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.692378] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.692524] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: c23f611f-cf67-43b1-b9f8-2ffafacf7697 is going to be created. [ 744.714874] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.714974] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.715116] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.715457] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.715758] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.716064] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-c23f611f-cf67-43b1-b9f8-2ffafacf7697" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.814745] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.815072] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.815164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.815400] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.815661] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.815764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.815764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.815888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.815979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.816075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.816225] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.816321] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.816423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.816510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.816648] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.816772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.816837] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.816984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.817069] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.817147] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.817237] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.831941] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: SUCCESS [ 744.832204] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.020422] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.020422] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.020422] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.020742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.020742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.023232] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 745.059554] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.059704] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.059779] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.060056] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.060225] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.072131] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 745.123202] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a438192e-41a1-4626-a0cd-45536ab2845a [ 745.123573] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.123573] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.123705] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.123941] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.124125] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.124229] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a438192e-41a1-4626-a0cd-45536ab2845a already deleted. [ 745.124417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a438192e-41a1-4626-a0cd-45536ab2845a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.319467] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc9a0c95-f9f4-4eb7-a275-05d69816e71d: rpc.has_security_group_logging(os_id): False [ 745.340509] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.340721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.340721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.340925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.341037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.341306] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.341448] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.341522] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.341682] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.341782] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.342015] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.342127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.342190] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.342352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.342453] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.342653] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.342750] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.342811] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.342954] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.343050] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.343142] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d is going to be created. [ 745.412287] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.412454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.412454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.412666] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.412847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.428148] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d in Status: IN_PROGRESS for 2s [ 745.475415] env[66994]: INFO networking_nsxv3.common.synchronization [req-9a3bd7f0-cf62-485f-a91f-d3a12fdfea29 req-ab81f867-dfae-46a4-9af9-25f51b4a3a46 service nova] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_rules [ 745.475565] env[66994]: INFO networking_nsxv3.common.synchronization [req-9a3bd7f0-cf62-485f-a91f-d3a12fdfea29 req-ab81f867-dfae-46a4-9af9-25f51b4a3a46 service nova] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 745.475695] env[66994]: INFO networking_nsxv3.common.synchronization [req-9a3bd7f0-cf62-485f-a91f-d3a12fdfea29 req-ab81f867-dfae-46a4-9af9-25f51b4a3a46 service nova] Enqueued Resource ID: c23f611f-cf67-43b1-b9f8-2ffafacf7697 with Priority: HIGHEST for action port [ 745.476500] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_rules [ 745.476604] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 745.476751] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c23f611f-cf67-43b1-b9f8-2ffafacf7697 with Priority: HIGHEST for action port [ 745.477080] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.477212] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.477355] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.477567] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.477689] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.482038] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.482038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.482038] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-c23f611f-cf67-43b1-b9f8-2ffafacf7697 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.482038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c23f611f-cf67-43b1-b9f8-2ffafacf7697" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.482038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c23f611f-cf67-43b1-b9f8-2ffafacf7697" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.482038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c23f611f-cf67-43b1-b9f8-2ffafacf7697" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.482038] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c23f611f-cf67-43b1-b9f8-2ffafacf7697',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.982568] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.982880] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.983014] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c23f611f-cf67-43b1-b9f8-2ffafacf7697 with status ACTIVE [ 745.983228] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.983313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.983357] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.983567] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.983657] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.983823] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.983967] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.984047] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.984218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.984329] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.984521] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.984619] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.984679] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.984821] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.984894] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.984982] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c23f611f-cf67-43b1-b9f8-2ffafacf7697 is going to be updated. [ 746.011173] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.011360] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.011404] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.011594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.011731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.011891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c23f611f-cf67-43b1-b9f8-2ffafacf7697" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.418013] env[66994]: INFO networking_nsxv3.common.synchronization [req-7f91bec1-0bcc-4247-8df3-f56bee878ef1 req-151f81fc-69c8-4e44-a283-164013058f06 tempest-ServersTestJSON-428956918 tempest-ServersTestJSON-428956918-project-member] Enqueued Resource ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 with Priority: HIGHEST for action security_group_members [ 746.418474] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 with Priority: HIGHEST for action security_group_members [ 746.418778] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-34bde346-4da1-4dd8-ad15-cd1afe320304 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.418902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.418965] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.420978] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.421122] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.421207] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.421260] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.421419] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.421504] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.421707] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34bde346-4da1-4dd8-ad15-cd1afe320304',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.662928] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91e3865c-9322-423a-9d64-5c548ef52da8 in Status: SUCCESS [ 746.663204] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91e3865c-9322-423a-9d64-5c548ef52da8 deletion is rescheduled due to dependency. [ 746.663425] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.812558] env[66994]: INFO networking_nsxv3.common.synchronization [req-05fd2957-1063-46e1-8b97-ab57fd603403 req-454a5868-dc28-4e83-b054-d2dfc18542d2 tempest-ServerGroupTestJSON-1898268120 tempest-ServerGroupTestJSON-1898268120-project-member] Enqueued Resource ID: dec0b14a-938b-49d8-be95-1b62d57e23e2 with Priority: HIGHEST for action security_group_members [ 746.813145] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dec0b14a-938b-49d8-be95-1b62d57e23e2 with Priority: HIGHEST for action security_group_members [ 746.813472] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-dec0b14a-938b-49d8-be95-1b62d57e23e2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.815567] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.815567] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.815567] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.815567] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.815567] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.815567] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.815946] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.815946] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.815946] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dec0b14a-938b-49d8-be95-1b62d57e23e2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.925986] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.926182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.926275] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.926513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.926609] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.926844] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.926920] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.926964] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.927133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.927210] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.927296] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 already deleted. [ 746.927374] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.989791] env[66994]: INFO networking_nsxv3.common.synchronization [None req-b3c14389-6ea1-4f89-bd30-49912ab3f31d tempest-AttachInterfacesUnderV243Test-1857034108 tempest-AttachInterfacesUnderV243Test-1857034108-project-member] Enqueued Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_rules [ 746.990420] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_rules [ 746.990778] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d884cf8-f142-472b-a29a-26176fe2cf88 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.992449] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.992524] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.992800] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.992900] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.083709] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 747.084026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.084216] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.084452] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.084649] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.084766] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.084828] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.084990] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.085094] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.085189] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.156167] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-365 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.156167] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-365" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.156167] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-365" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.156167] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-365" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.156167] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.156167] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.156167] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.156717] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.156944] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.157082] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 747.157192] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 747.157293] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 747.157395] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 747.157499] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 747.157597] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 747.157726] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 747.179028] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 747.179259] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 747.179337] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 747.179440] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-365" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.179819] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-d04dd7b1-2890-4cab-8bb2-ad8985e0df22 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.180438] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-d04dd7b1-2890-4cab-8bb2-ad8985e0df22" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.180438] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-d04dd7b1-2890-4cab-8bb2-ad8985e0df22" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.180438] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-d04dd7b1-2890-4cab-8bb2-ad8985e0df22" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.181134] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d04dd7b1-2890-4cab-8bb2-ad8985e0df22',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.258485] env[66994]: INFO networking_nsxv3.common.synchronization [None req-a2620abe-1bac-4c23-a230-49239106ae05 tempest-AttachInterfacesUnderV243Test-1857034108 tempest-AttachInterfacesUnderV243Test-1857034108-project-member] Enqueued Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_rules [ 747.259096] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_rules [ 747.259426] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d884cf8-f142-472b-a29a-26176fe2cf88 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.259549] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.318421] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.318739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.318855] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.319096] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.319201] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.319465] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.319607] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.319771] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.320973] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.320973] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.320973] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dec0b14a-938b-49d8-be95-1b62d57e23e2 is going to be updated. [ 747.354544] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.354699] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.354756] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.355044] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.355202] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.365231] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dec0b14a-938b-49d8-be95-1b62d57e23e2 in Status: IN_PROGRESS for 2s [ 747.443654] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d in Status: SUCCESS [ 747.443940] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.515210] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.515210] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.515210] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.515534] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.515534] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.515603] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 already deleted. [ 747.515672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.515788] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.515946] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.516043] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.589021] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.683728] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.683728] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.683728] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.683961] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.684067] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.684221] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port d04dd7b1-2890-4cab-8bb2-ad8985e0df22 not found, creating... [ 747.684465] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.684614] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.684722] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.684966] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.685110] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.685410] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.685563] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.685672] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.686027] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.686027] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.686136] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: d04dd7b1-2890-4cab-8bb2-ad8985e0df22 is going to be created. [ 747.706619] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.706926] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.707114] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.707421] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.707656] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.707923] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-d04dd7b1-2890-4cab-8bb2-ad8985e0df22" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.037415] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.037415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.037415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.038206] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.038206] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.038206] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 already deleted. [ 748.038206] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.093550] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.510185] env[66994]: INFO networking_nsxv3.common.synchronization [req-7f91bec1-0bcc-4247-8df3-f56bee878ef1 req-0b5bd67a-8fdd-49ca-9d57-ef81e427cc73 service nova] Enqueued Resource ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 with Priority: HIGHEST for action security_group_rules [ 748.510185] env[66994]: INFO networking_nsxv3.common.synchronization [req-7f91bec1-0bcc-4247-8df3-f56bee878ef1 req-0b5bd67a-8fdd-49ca-9d57-ef81e427cc73 service nova] Enqueued Resource ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 with Priority: HIGHEST for action security_group_members [ 748.510185] env[66994]: INFO networking_nsxv3.common.synchronization [req-7f91bec1-0bcc-4247-8df3-f56bee878ef1 req-0b5bd67a-8fdd-49ca-9d57-ef81e427cc73 service nova] Enqueued Resource ID: d04dd7b1-2890-4cab-8bb2-ad8985e0df22 with Priority: HIGHEST for action port [ 748.510441] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 with Priority: HIGHEST for action security_group_rules [ 748.510441] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 with Priority: HIGHEST for action security_group_members [ 748.510510] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d04dd7b1-2890-4cab-8bb2-ad8985e0df22 with Priority: HIGHEST for action port [ 748.511074] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34bde346-4da1-4dd8-ad15-cd1afe320304 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.511224] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.511290] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.511490] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.511571] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34bde346-4da1-4dd8-ad15-cd1afe320304',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.513254] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-34bde346-4da1-4dd8-ad15-cd1afe320304 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.513254] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.513254] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.513254] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.513548] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.513548] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.513548] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.514528] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.514528] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.514528] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34bde346-4da1-4dd8-ad15-cd1afe320304',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.514711] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-d04dd7b1-2890-4cab-8bb2-ad8985e0df22 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.514711] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d04dd7b1-2890-4cab-8bb2-ad8985e0df22" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.514711] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d04dd7b1-2890-4cab-8bb2-ad8985e0df22" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.514847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d04dd7b1-2890-4cab-8bb2-ad8985e0df22" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.514920] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d04dd7b1-2890-4cab-8bb2-ad8985e0df22',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.598662] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.598662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.598662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.598662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.598662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.598662] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 748.635199] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.635199] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.635199] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.635199] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.635199] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.651060] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 748.912110] env[66994]: INFO networking_nsxv3.common.synchronization [req-a782e293-8693-4d37-ade7-18e4050b9ad2 req-6444befd-33d8-4ea2-ade9-27e911736ef8 tempest-ServersTestBootFromVolume-2076386020 tempest-ServersTestBootFromVolume-2076386020-project-member] Enqueued Resource ID: 7176e416-370c-4ff8-be5b-5551a672ed01 with Priority: HIGHEST for action security_group_members [ 748.912110] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7176e416-370c-4ff8-be5b-5551a672ed01 with Priority: HIGHEST for action security_group_members [ 748.912110] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-7176e416-370c-4ff8-be5b-5551a672ed01 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.912110] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.912110] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.913551] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.914062] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.914611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.915983] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.917435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.917435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.917435] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7176e416-370c-4ff8-be5b-5551a672ed01',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.928318] env[66994]: INFO networking_nsxv3.common.synchronization [req-2ead120f-1bd2-4c85-a390-a275ca09f5be req-8278dde0-de61-4c75-8cd4-8e89dbff73e8 tempest-ImagesOneServerNegativeTestJSON-1432587522 tempest-ImagesOneServerNegativeTestJSON-1432587522-project-member] Enqueued Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_members [ 748.930017] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_members [ 748.930382] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-11c0b684-9731-4046-89ad-f4bf7b2168d4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.930526] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.930877] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.931114] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.931317] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.931421] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.931532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.932014] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.932150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.932274] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.016250] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34bde346-4da1-4dd8-ad15-cd1afe320304',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.017308] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-34bde346-4da1-4dd8-ad15-cd1afe320304 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.017440] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.020143] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d04dd7b1-2890-4cab-8bb2-ad8985e0df22 with status ACTIVE [ 749.020348] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.020703] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.020852] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.021064] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.021191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.021394] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.021644] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.021644] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.022078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.022409] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.022840] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.022967] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.023070] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.023260] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.023345] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.023454] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d04dd7b1-2890-4cab-8bb2-ad8985e0df22 is going to be updated. [ 749.051982] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.052347] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.052347] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.052439] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.052556] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.052698] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d04dd7b1-2890-4cab-8bb2-ad8985e0df22" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.378213] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dec0b14a-938b-49d8-be95-1b62d57e23e2 in Status: SUCCESS [ 749.378529] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dec0b14a-938b-49d8-be95-1b62d57e23e2 deletion is rescheduled due to dependency. [ 749.378655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.420420] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.420635] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.420635] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.421787] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.421787] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.421787] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.421787] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.421787] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.421787] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.421787] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.421787] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7176e416-370c-4ff8-be5b-5551a672ed01 is going to be updated. [ 749.437812] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.438036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.439078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.439078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.439078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.439078] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.439078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.439078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.439078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.439078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.439393] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 is going to be updated. [ 749.456956] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.457235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.457308] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.457526] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.457690] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.461087] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-767 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.461327] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-767" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.461491] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-767" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.461821] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-767" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.462214] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.462420] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.462577] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.462871] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.463067] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.463323] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 749.463473] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 749.463608] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 749.463735] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 749.463940] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 749.464095] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 749.464267] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 749.468901] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7176e416-370c-4ff8-be5b-5551a672ed01 in Status: IN_PROGRESS for 2s [ 749.478660] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.478865] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.478972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.479284] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.479460] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.491711] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 in Status: IN_PROGRESS for 2s [ 749.502689] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 749.502980] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 749.503256] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 749.503470] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-767" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.504014] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-e0b9c881-8aed-449b-b0f5-fa9cb874aaa2 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.504334] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-e0b9c881-8aed-449b-b0f5-fa9cb874aaa2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.504455] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-e0b9c881-8aed-449b-b0f5-fa9cb874aaa2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.504831] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-e0b9c881-8aed-449b-b0f5-fa9cb874aaa2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.504948] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0b9c881-8aed-449b-b0f5-fa9cb874aaa2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.518952] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34bde346-4da1-4dd8-ad15-cd1afe320304',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.008278] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.008465] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.008569] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.008870] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.009020] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.009184] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port e0b9c881-8aed-449b-b0f5-fa9cb874aaa2 not found, creating... [ 750.009598] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.009598] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.009814] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.009900] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.010042] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.010324] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.010787] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.010787] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.010787] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.011031] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.011156] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: e0b9c881-8aed-449b-b0f5-fa9cb874aaa2 is going to be created. [ 750.021174] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.021429] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.021487] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.021806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.021806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.021912] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 is going to be created. [ 750.037210] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.037639] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.038190] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.038190] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.038391] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.038582] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-e0b9c881-8aed-449b-b0f5-fa9cb874aaa2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.050481] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.050729] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.050729] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.051054] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.051198] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.061449] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 in Status: UNINITIALIZED for 2s [ 750.664471] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 750.664471] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.664825] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.665112] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.667352] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.667352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.667352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.667352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.667352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.667352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.667352] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.734437] env[66994]: INFO networking_nsxv3.common.synchronization [req-2ead120f-1bd2-4c85-a390-a275ca09f5be req-bfdcda06-3f97-4475-bd3d-a94d667bde34 service nova] Enqueued Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_rules [ 750.734437] env[66994]: INFO networking_nsxv3.common.synchronization [req-2ead120f-1bd2-4c85-a390-a275ca09f5be req-bfdcda06-3f97-4475-bd3d-a94d667bde34 service nova] Enqueued Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_members [ 750.734437] env[66994]: INFO networking_nsxv3.common.synchronization [req-2ead120f-1bd2-4c85-a390-a275ca09f5be req-bfdcda06-3f97-4475-bd3d-a94d667bde34 service nova] Enqueued Resource ID: e0b9c881-8aed-449b-b0f5-fa9cb874aaa2 with Priority: HIGHEST for action port [ 750.734437] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_rules [ 750.734437] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_members [ 750.734437] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0b9c881-8aed-449b-b0f5-fa9cb874aaa2 with Priority: HIGHEST for action port [ 750.736812] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11c0b684-9731-4046-89ad-f4bf7b2168d4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.736959] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.737030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.737257] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.737342] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.739272] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-11c0b684-9731-4046-89ad-f4bf7b2168d4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.739272] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.739272] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0b9c881-8aed-449b-b0f5-fa9cb874aaa2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.739272] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0b9c881-8aed-449b-b0f5-fa9cb874aaa2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.739537] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0b9c881-8aed-449b-b0f5-fa9cb874aaa2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.739537] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0b9c881-8aed-449b-b0f5-fa9cb874aaa2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.739646] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0b9c881-8aed-449b-b0f5-fa9cb874aaa2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.776448] env[66994]: INFO networking_nsxv3.common.synchronization [None req-2563244c-2bd2-4104-ab3c-4de657a80d19 None None] Enqueued Resource ID: 3df25935-e31e-4c1b-a903-b0048f1a0f46 with Priority: HIGHEST for action port [ 750.776966] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df25935-e31e-4c1b-a903-b0048f1a0f46 with Priority: HIGHEST for action port [ 750.777271] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-3df25935-e31e-4c1b-a903-b0048f1a0f46 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.777380] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3df25935-e31e-4c1b-a903-b0048f1a0f46" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.777453] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3df25935-e31e-4c1b-a903-b0048f1a0f46" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.777702] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3df25935-e31e-4c1b-a903-b0048f1a0f46" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.777859] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3df25935-e31e-4c1b-a903-b0048f1a0f46',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.143563] env[66994]: INFO networking_nsxv3.common.synchronization [req-4abb5d63-8dae-4e34-934f-75fd45503b3b req-30df999d-528f-4745-81fa-18450fa671b7 tempest-MultipleCreateTestJSON-651107876 tempest-MultipleCreateTestJSON-651107876-project-member] Enqueued Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 751.143563] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 751.143948] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.143948] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.144053] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.144215] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.144372] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.144478] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.144538] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.144689] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.144769] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.144920] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.172178] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.172350] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.172403] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.172615] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.175710] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.175710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.175710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.175710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.175710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.175710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.175710] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.175710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.175710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.175710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.175710] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.175710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.175710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.176219] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.176219] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.176219] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.176219] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.243753] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-11c0b684-9731-4046-89ad-f4bf7b2168d4 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.243986] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.244189] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0b9c881-8aed-449b-b0f5-fa9cb874aaa2 with status ACTIVE [ 751.244373] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.244494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.244560] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.244771] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.244913] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.247752] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.247752] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.247752] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.247752] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.247752] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.247752] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.247752] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.247752] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.247752] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.247752] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.247752] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0b9c881-8aed-449b-b0f5-fa9cb874aaa2 is going to be updated. [ 751.270218] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.270349] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.270387] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.271023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.271023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.271023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0b9c881-8aed-449b-b0f5-fa9cb874aaa2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.279926] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3df25935-e31e-4c1b-a903-b0048f1a0f46 [ 751.280188] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.280338] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.280431] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.283681] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.283681] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.283681] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3df25935-e31e-4c1b-a903-b0048f1a0f46 already deleted. [ 751.283681] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3df25935-e31e-4c1b-a903-b0048f1a0f46" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.480399] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7176e416-370c-4ff8-be5b-5551a672ed01 in Status: SUCCESS [ 751.480639] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7176e416-370c-4ff8-be5b-5551a672ed01 deletion is rescheduled due to dependency. [ 751.481166] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.504326] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 in Status: SUCCESS [ 751.504505] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 deletion is rescheduled due to dependency. [ 751.504634] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.507817] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.507817] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.507817] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.507817] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.507817] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.507817] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.507817] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.507817] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.647509] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.647684] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.647795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.648149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.648323] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.648648] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.648814] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.648928] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.649211] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.649362] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.649514] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 is going to be updated. [ 751.681175] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.681175] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.681175] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.681175] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.681175] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.681175] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8: rpc.has_security_group_logging(os_id): False [ 751.686204] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-116 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.686391] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-116" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.686506] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-116" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.686813] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-116" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.687053] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.687211] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.687320] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.687528] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.687661] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.687864] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 751.687970] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 751.689112] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 751.689112] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 751.689112] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 751.689112] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 751.689112] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 751.695011] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: IN_PROGRESS for 2s [ 751.710672] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.710672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.710672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.710672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.710672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.710926] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.710926] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.711012] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.711130] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.711209] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.711554] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.711630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.711666] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.711858] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.711991] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.712166] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.712257] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.712392] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.712524] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.712605] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.712691] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 751.714863] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 751.714863] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 751.714979] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 751.715286] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-116" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.715582] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-efdc42bf-3166-495b-a274-2104c6b6fe51 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.715765] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-efdc42bf-3166-495b-a274-2104c6b6fe51" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.715901] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-efdc42bf-3166-495b-a274-2104c6b6fe51" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.716338] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-efdc42bf-3166-495b-a274-2104c6b6fe51" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.716494] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efdc42bf-3166-495b-a274-2104c6b6fe51',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.794410] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.794666] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.794666] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.794849] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.795054] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.823410] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 752.009747] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.072404] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 in Status: SUCCESS [ 752.072532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.072688] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.072906] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.073106] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.073230] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.073282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.073481] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.073553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.073637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.073738] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34bde346-4da1-4dd8-ad15-cd1afe320304',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.207690] env[66994]: INFO networking_nsxv3.common.synchronization [req-ebd3556e-8301-43f5-aa09-086fb04a4623 req-914bcbfb-b912-4e25-97aa-ce2721c97db1 tempest-SecurityGroupRulesNegativeTestJSON-393875186 tempest-SecurityGroupRulesNegativeTestJSON-393875186-project-member] Enqueued Resource ID: dd48b835-f116-4006-a276-44a93783c6bb with Priority: HIGHEST for action security_group_rules [ 752.209772] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd48b835-f116-4006-a276-44a93783c6bb with Priority: HIGHEST for action security_group_rules [ 752.209772] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd48b835-f116-4006-a276-44a93783c6bb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.210037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd48b835-f116-4006-a276-44a93783c6bb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.210037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd48b835-f116-4006-a276-44a93783c6bb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.210186] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd48b835-f116-4006-a276-44a93783c6bb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.210312] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd48b835-f116-4006-a276-44a93783c6bb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.220748] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.221566] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.221566] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.221566] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.221720] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.221831] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port efdc42bf-3166-495b-a274-2104c6b6fe51 not found, creating... [ 752.222660] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.222887] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.223090] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.223940] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.223940] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.224438] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.224603] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.225188] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.225188] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.225188] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.225364] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: efdc42bf-3166-495b-a274-2104c6b6fe51 is going to be created. [ 752.251990] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.252330] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.252550] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.252901] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.253220] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.253504] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-efdc42bf-3166-495b-a274-2104c6b6fe51" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.512220] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.576333] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34bde346-4da1-4dd8-ad15-cd1afe320304',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.739579] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.739579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.739579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.739579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.739579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.739579] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd48b835-f116-4006-a276-44a93783c6bb already deleted. [ 752.739579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd48b835-f116-4006-a276-44a93783c6bb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.852962] env[66994]: INFO networking_nsxv3.common.synchronization [None req-86ce3782-c698-4e0d-866b-2fdf20111220 None None] Enqueued Resource ID: 0bc0aeab-75d9-4369-a9fa-81966259d21e with Priority: HIGHEST for action port [ 752.856116] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc0aeab-75d9-4369-a9fa-81966259d21e with Priority: HIGHEST for action port [ 752.856116] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bc0aeab-75d9-4369-a9fa-81966259d21e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.856116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bc0aeab-75d9-4369-a9fa-81966259d21e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.856116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bc0aeab-75d9-4369-a9fa-81966259d21e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.856116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bc0aeab-75d9-4369-a9fa-81966259d21e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.856116] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bc0aeab-75d9-4369-a9fa-81966259d21e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.015249] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.015393] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.015455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.015715] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.015821] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.015985] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 is going to be updated. [ 753.053713] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.054731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.054731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.054731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.054731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.057748] env[66994]: INFO networking_nsxv3.common.synchronization [req-4abb5d63-8dae-4e34-934f-75fd45503b3b req-96765f53-5a78-428b-937a-7e797d926c50 service nova] Enqueued Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_rules [ 753.057748] env[66994]: INFO networking_nsxv3.common.synchronization [req-4abb5d63-8dae-4e34-934f-75fd45503b3b req-96765f53-5a78-428b-937a-7e797d926c50 service nova] Enqueued Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 753.057854] env[66994]: INFO networking_nsxv3.common.synchronization [req-4abb5d63-8dae-4e34-934f-75fd45503b3b req-96765f53-5a78-428b-937a-7e797d926c50 service nova] Enqueued Resource ID: efdc42bf-3166-495b-a274-2104c6b6fe51 with Priority: HIGHEST for action port [ 753.058409] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_rules [ 753.058565] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 753.058661] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efdc42bf-3166-495b-a274-2104c6b6fe51 with Priority: HIGHEST for action port [ 753.058975] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.059166] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.059270] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.059810] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.059810] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.060722] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.060833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.061095] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-efdc42bf-3166-495b-a274-2104c6b6fe51 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.061217] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efdc42bf-3166-495b-a274-2104c6b6fe51" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.061274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efdc42bf-3166-495b-a274-2104c6b6fe51" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.061530] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efdc42bf-3166-495b-a274-2104c6b6fe51" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.061607] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efdc42bf-3166-495b-a274-2104c6b6fe51',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.067586] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 in Status: IN_PROGRESS for 2s [ 753.079844] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34bde346-4da1-4dd8-ad15-cd1afe320304: rpc.has_security_group_logging(os_id): False [ 753.104663] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.104961] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.104961] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.105219] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.105369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.105648] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.105758] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.105822] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.105992] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.106087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.106176] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 is going to be created. [ 753.187645] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.187831] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.189108] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.189108] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.189108] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.202373] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 in Status: IN_PROGRESS for 2s [ 753.252699] env[66994]: INFO networking_nsxv3.common.synchronization [req-4abb5d63-8dae-4e34-934f-75fd45503b3b req-38b2c38d-246e-455d-8b4a-c3e5f84dee1a tempest-MultipleCreateTestJSON-651107876 tempest-MultipleCreateTestJSON-651107876-project-member] Enqueued Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 753.253582] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 753.253582] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.253718] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.357994] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0bc0aeab-75d9-4369-a9fa-81966259d21e [ 753.357994] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.357994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.357994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.357994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.357994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.357994] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0bc0aeab-75d9-4369-a9fa-81966259d21e already deleted. [ 753.357994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bc0aeab-75d9-4369-a9fa-81966259d21e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.563181] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.564184] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.564184] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port efdc42bf-3166-495b-a274-2104c6b6fe51 with status ACTIVE [ 753.564184] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.564184] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.564184] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.564576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.564576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.564630] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.564700] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.565232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.565232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.565232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.565232] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.565557] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.565557] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.565557] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.565664] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.565737] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: efdc42bf-3166-495b-a274-2104c6b6fe51 is going to be updated. [ 753.594047] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.594047] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.594047] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.594047] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.594047] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.594047] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efdc42bf-3166-495b-a274-2104c6b6fe51" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.665570] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-116 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.666285] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-116" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.666285] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-116" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.666451] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-116" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.666695] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.666850] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.666968] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.667608] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.667608] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.667608] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 753.667784] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 753.667861] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 753.668016] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 753.668190] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 753.668299] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 753.668403] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 753.694960] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 753.695299] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 753.695500] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 753.695665] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-116" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.695889] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-9e78a191-f3c2-4a69-8ac3-4968fb43a165 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.696067] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-9e78a191-f3c2-4a69-8ac3-4968fb43a165" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.696270] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-9e78a191-f3c2-4a69-8ac3-4968fb43a165" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.696519] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-9e78a191-f3c2-4a69-8ac3-4968fb43a165" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.696739] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e78a191-f3c2-4a69-8ac3-4968fb43a165',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.711071] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: SUCCESS [ 753.711071] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 deletion is rescheduled due to dependency. [ 753.711282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.711313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.711789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.711789] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.711949] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.711949] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.712364] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.712364] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.712364] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.840148] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 753.840404] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.202670] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.202904] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.203083] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.203488] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.203566] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.203733] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 9e78a191-f3c2-4a69-8ac3-4968fb43a165 not found, creating... [ 754.204213] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.204379] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.204520] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.204817] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.205032] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.205368] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.205569] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.205724] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.206010] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.206183] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.206450] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 9e78a191-f3c2-4a69-8ac3-4968fb43a165 is going to be created. [ 754.215395] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.229108] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.229359] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.229488] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.229775] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.229980] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.230223] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-9e78a191-f3c2-4a69-8ac3-4968fb43a165" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.717449] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.981385] env[66994]: INFO networking_nsxv3.common.synchronization [req-4abb5d63-8dae-4e34-934f-75fd45503b3b req-88365de1-846a-4d15-97c1-67d0406b1af4 service nova] Enqueued Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_rules [ 754.981385] env[66994]: INFO networking_nsxv3.common.synchronization [req-4abb5d63-8dae-4e34-934f-75fd45503b3b req-88365de1-846a-4d15-97c1-67d0406b1af4 service nova] Enqueued Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 754.981385] env[66994]: INFO networking_nsxv3.common.synchronization [req-4abb5d63-8dae-4e34-934f-75fd45503b3b req-88365de1-846a-4d15-97c1-67d0406b1af4 service nova] Enqueued Resource ID: 9e78a191-f3c2-4a69-8ac3-4968fb43a165 with Priority: HIGHEST for action port [ 754.981385] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_rules [ 754.981385] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 754.981385] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e78a191-f3c2-4a69-8ac3-4968fb43a165 with Priority: HIGHEST for action port [ 754.981385] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.981385] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.984466] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.984776] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.986958] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e78a191-f3c2-4a69-8ac3-4968fb43a165 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.986958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e78a191-f3c2-4a69-8ac3-4968fb43a165" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.986958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e78a191-f3c2-4a69-8ac3-4968fb43a165" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.986958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e78a191-f3c2-4a69-8ac3-4968fb43a165" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.986958] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e78a191-f3c2-4a69-8ac3-4968fb43a165',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.079074] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 in Status: SUCCESS [ 755.079464] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.079800] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.080507] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.080743] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.082693] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.082693] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.082693] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.082693] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.082693] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.082693] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.215902] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 in Status: SUCCESS [ 755.216163] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.220126] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.220281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.220357] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.220776] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.220776] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.220776] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 is going to be updated. [ 755.256141] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.256584] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.256584] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.256664] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.256818] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.275096] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: IN_PROGRESS for 2s [ 755.489338] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e78a191-f3c2-4a69-8ac3-4968fb43a165 with status ACTIVE [ 755.489707] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.489912] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.489991] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.490246] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.490317] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.490470] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.490573] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.490633] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.490788] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.490863] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.491058] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.491155] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.491215] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.491351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.491421] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.491504] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e78a191-f3c2-4a69-8ac3-4968fb43a165 is going to be updated. [ 755.519196] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.519400] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.519400] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.519671] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.519736] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.519893] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e78a191-f3c2-4a69-8ac3-4968fb43a165" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.583724] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-11c0b684-9731-4046-89ad-f4bf7b2168d4 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.583724] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.584029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.584185] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.585049] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.585049] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.585049] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.585049] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.585049] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.585049] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.585319] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-11c0b684-9731-4046-89ad-f4bf7b2168d4 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.585319] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.585319] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.585428] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.585739] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.585739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.585739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.585739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.585739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.585739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.585739] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.088857] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11c0b684-9731-4046-89ad-f4bf7b2168d4: rpc.has_security_group_logging(os_id): False [ 756.115276] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.115470] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.115528] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.115710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.115800] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.116032] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.116133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.116197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.116389] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.116488] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.116710] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.116868] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.116954] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.117208] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.117347] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.117570] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.118076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.118076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.118076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.118076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.118249] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 is going to be updated. [ 756.219772] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.220213] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.220213] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.220326] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.220385] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.238513] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 in Status: IN_PROGRESS for 2s [ 756.355383] env[66994]: INFO networking_nsxv3.common.synchronization [None req-6495a21b-8d60-419e-88b3-36f16182683b None None] Enqueued Resource ID: b946ee7e-e053-433c-916e-de2d6bd95a4c with Priority: HIGHEST for action port [ 756.355383] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b946ee7e-e053-433c-916e-de2d6bd95a4c with Priority: HIGHEST for action port [ 756.355383] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-b946ee7e-e053-433c-916e-de2d6bd95a4c taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.355383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b946ee7e-e053-433c-916e-de2d6bd95a4c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.355383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b946ee7e-e053-433c-916e-de2d6bd95a4c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.355383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b946ee7e-e053-433c-916e-de2d6bd95a4c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.355383] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b946ee7e-e053-433c-916e-de2d6bd95a4c',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.858411] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b946ee7e-e053-433c-916e-de2d6bd95a4c [ 756.858740] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.858852] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.858852] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.859311] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.859311] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.859311] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b946ee7e-e053-433c-916e-de2d6bd95a4c already deleted. [ 756.859507] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b946ee7e-e053-433c-916e-de2d6bd95a4c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.148272] env[66994]: INFO networking_nsxv3.common.synchronization [req-ed87a1cc-4440-49fe-9204-e9416cc246e8 req-6412ede4-7ba2-4fea-90d0-8406df6d87b4 tempest-InstanceActionsNegativeTestJSON-2071449854 tempest-InstanceActionsNegativeTestJSON-2071449854-project-member] Enqueued Resource ID: 44494650-6b02-4361-a53d-fb11ecaa53f2 with Priority: HIGHEST for action security_group_members [ 757.148846] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44494650-6b02-4361-a53d-fb11ecaa53f2 with Priority: HIGHEST for action security_group_members [ 757.149792] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-44494650-6b02-4361-a53d-fb11ecaa53f2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.149792] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.149792] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.149792] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.149792] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.149792] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.150433] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.150693] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.151336] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.151336] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44494650-6b02-4361-a53d-fb11ecaa53f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.293282] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: SUCCESS [ 757.293282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.293282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.293282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.293282] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.293282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.293282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.293282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.293282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.293282] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.652604] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-340 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.653501] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-340" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.653501] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-340" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.653501] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-340" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.653861] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.654064] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.654380] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.654633] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.654795] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.655073] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 757.655263] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 757.655407] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 757.655543] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 757.655686] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 757.655829] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 757.656534] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 757.658246] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.658395] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.658471] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.658655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.658740] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.658935] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.659041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.659097] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.659253] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.659331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.659414] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44494650-6b02-4361-a53d-fb11ecaa53f2 already deleted. [ 757.659490] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.681274] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 757.681462] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 757.681556] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 757.684224] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-340" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.684601] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-e7e04777-f8a0-4af3-b522-0acf2aba416f taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.685082] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-e7e04777-f8a0-4af3-b522-0acf2aba416f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.685082] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-e7e04777-f8a0-4af3-b522-0acf2aba416f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.685315] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-e7e04777-f8a0-4af3-b522-0acf2aba416f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.685457] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7e04777-f8a0-4af3-b522-0acf2aba416f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.796640] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.191295] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.191640] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.191837] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.192309] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.192476] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.192715] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port e7e04777-f8a0-4af3-b522-0acf2aba416f not found, creating... [ 758.193196] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.193466] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.193668] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.194026] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.194904] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.194904] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.195990] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.196613] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.197360] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.197642] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.197892] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: e7e04777-f8a0-4af3-b522-0acf2aba416f is going to be created. [ 758.225850] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.226091] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.226277] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.226588] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.226843] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.227071] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-e7e04777-f8a0-4af3-b522-0acf2aba416f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.255994] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 in Status: SUCCESS [ 758.256326] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.302046] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.804933] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.804933] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.805050] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.806880] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.806880] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.806880] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 is going to be updated. [ 758.842612] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.843036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.843151] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.843282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.843452] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.857015] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: IN_PROGRESS for 2s [ 758.982705] env[66994]: INFO networking_nsxv3.common.synchronization [req-ed87a1cc-4440-49fe-9204-e9416cc246e8 req-e3d5bd01-c324-402e-80bd-e5a9c1327399 service nova] Enqueued Resource ID: 44494650-6b02-4361-a53d-fb11ecaa53f2 with Priority: HIGHEST for action security_group_rules [ 758.982960] env[66994]: INFO networking_nsxv3.common.synchronization [req-ed87a1cc-4440-49fe-9204-e9416cc246e8 req-e3d5bd01-c324-402e-80bd-e5a9c1327399 service nova] Enqueued Resource ID: 44494650-6b02-4361-a53d-fb11ecaa53f2 with Priority: HIGHEST for action security_group_members [ 758.983147] env[66994]: INFO networking_nsxv3.common.synchronization [req-ed87a1cc-4440-49fe-9204-e9416cc246e8 req-e3d5bd01-c324-402e-80bd-e5a9c1327399 service nova] Enqueued Resource ID: e7e04777-f8a0-4af3-b522-0acf2aba416f with Priority: HIGHEST for action port [ 758.983794] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44494650-6b02-4361-a53d-fb11ecaa53f2 with Priority: HIGHEST for action security_group_rules [ 758.983997] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44494650-6b02-4361-a53d-fb11ecaa53f2 with Priority: HIGHEST for action security_group_members [ 758.983997] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7e04777-f8a0-4af3-b522-0acf2aba416f with Priority: HIGHEST for action port [ 758.984438] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44494650-6b02-4361-a53d-fb11ecaa53f2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.984568] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.984663] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.985103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.985198] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44494650-6b02-4361-a53d-fb11ecaa53f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.990413] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-44494650-6b02-4361-a53d-fb11ecaa53f2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.990413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.990413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.990413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.990413] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.990413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.990413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.990413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.990413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.990413] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44494650-6b02-4361-a53d-fb11ecaa53f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.991303] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7e04777-f8a0-4af3-b522-0acf2aba416f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.991815] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7e04777-f8a0-4af3-b522-0acf2aba416f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.991895] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7e04777-f8a0-4af3-b522-0acf2aba416f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.992944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7e04777-f8a0-4af3-b522-0acf2aba416f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.993122] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7e04777-f8a0-4af3-b522-0acf2aba416f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.176379] env[66994]: INFO networking_nsxv3.common.synchronization [None req-97cc0625-bd13-482b-8f88-edffecaaba18 None None] Enqueued Resource ID: f653ecbe-3920-472a-a9df-993826d4c021 with Priority: HIGHEST for action port [ 759.176379] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f653ecbe-3920-472a-a9df-993826d4c021 with Priority: HIGHEST for action port [ 759.176379] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-f653ecbe-3920-472a-a9df-993826d4c021 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.176379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f653ecbe-3920-472a-a9df-993826d4c021" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.176665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f653ecbe-3920-472a-a9df-993826d4c021" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.177393] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f653ecbe-3920-472a-a9df-993826d4c021" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.177393] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f653ecbe-3920-472a-a9df-993826d4c021',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.495508] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-44494650-6b02-4361-a53d-fb11ecaa53f2 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.495816] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.495816] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44494650-6b02-4361-a53d-fb11ecaa53f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.496840] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e7e04777-f8a0-4af3-b522-0acf2aba416f with status ACTIVE [ 759.500020] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.500020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.500020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.500020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.500020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.500020] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.500020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.500020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.500272] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.500272] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.500325] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.501017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.501017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.501017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.501017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.502633] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e7e04777-f8a0-4af3-b522-0acf2aba416f is going to be updated. [ 759.526581] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.526778] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.526778] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.527019] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.527128] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.527297] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7e04777-f8a0-4af3-b522-0acf2aba416f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.679445] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f653ecbe-3920-472a-a9df-993826d4c021 [ 759.679972] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.680116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.680157] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.680455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.680599] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.680755] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f653ecbe-3920-472a-a9df-993826d4c021 already deleted. [ 759.680903] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f653ecbe-3920-472a-a9df-993826d4c021" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.005471] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44494650-6b02-4361-a53d-fb11ecaa53f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.512329] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.512329] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.512329] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.512329] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.512329] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.512329] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44494650-6b02-4361-a53d-fb11ecaa53f2 is going to be created. [ 760.547043] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.547329] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.547329] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.547463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.547654] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.561606] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44494650-6b02-4361-a53d-fb11ecaa53f2 in Status: UNINITIALIZED for 2s [ 760.723741] env[66994]: INFO networking_nsxv3.common.synchronization [req-1a6ea890-c971-42d3-9d2f-693b00f5ac0d req-987167bb-e00a-4f80-b0f5-26c02cc0333c tempest-ServersTestMultiNic-1223700725 tempest-ServersTestMultiNic-1223700725-project-member] Enqueued Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 760.723864] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 760.724693] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.724865] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.724937] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.725462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.725462] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.725462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.726280] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.726280] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.726280] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.726280] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.867868] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: SUCCESS [ 760.868119] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.868384] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.868499] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.868691] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.868826] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.868896] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.869019] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.869154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.869191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.870741] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.871996] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.872872] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.873076] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.873195] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.873264] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.873488] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.873668] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.873777] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.930242] env[66994]: INFO networking_nsxv3.common.synchronization [None req-c84fc3f3-bbee-4f3f-9b0a-b2f9da9b36f6 None None] Enqueued Resource ID: db8ec59a-24fa-4343-affe-9b166b274d53 with Priority: HIGHEST for action port [ 760.930242] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db8ec59a-24fa-4343-affe-9b166b274d53 with Priority: HIGHEST for action port [ 760.930242] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-db8ec59a-24fa-4343-affe-9b166b274d53 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.930242] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db8ec59a-24fa-4343-affe-9b166b274d53" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.930242] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db8ec59a-24fa-4343-affe-9b166b274d53" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.930242] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db8ec59a-24fa-4343-affe-9b166b274d53" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.930242] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db8ec59a-24fa-4343-affe-9b166b274d53',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.124769] env[66994]: INFO networking_nsxv3.common.synchronization [req-1a6ea890-c971-42d3-9d2f-693b00f5ac0d req-8e1425e3-21c4-4bf9-8861-d8a22552d3a1 tempest-ServersTestMultiNic-1223700725 tempest-ServersTestMultiNic-1223700725-project-member] Enqueued Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 761.125250] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 761.126010] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.126132] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.231072] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.375755] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.375881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.378840] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.433106] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db8ec59a-24fa-4343-affe-9b166b274d53 [ 761.433213] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.433374] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.433440] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.434483] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.434483] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.434483] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db8ec59a-24fa-4343-affe-9b166b274d53 already deleted. [ 761.434483] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db8ec59a-24fa-4343-affe-9b166b274d53" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.505845] env[66994]: INFO networking_nsxv3.common.synchronization [req-1a6ea890-c971-42d3-9d2f-693b00f5ac0d req-94e03c3c-c551-4380-81b8-3295980014a4 tempest-ServersTestMultiNic-1223700725 tempest-ServersTestMultiNic-1223700725-project-member] Enqueued Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 761.507933] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 761.508313] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.508426] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.737023] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.883586] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.241352] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.241352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.241352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.241352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.241769] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.242024] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 is going to be updated. [ 762.288083] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.288083] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.288083] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.288083] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.288083] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.301583] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: IN_PROGRESS for 2s [ 762.387430] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.387655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.387988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.387988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.388137] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.388210] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 is going to be updated. [ 762.429367] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.429633] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.429633] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.430154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.430154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.441171] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: IN_PROGRESS for 2s [ 762.669529] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44494650-6b02-4361-a53d-fb11ecaa53f2 in Status: SUCCESS [ 762.669529] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.669999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.669999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.670446] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.670564] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.670627] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.670797] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.670951] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.670951] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.671099] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44494650-6b02-4361-a53d-fb11ecaa53f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.173830] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-44494650-6b02-4361-a53d-fb11ecaa53f2 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.174255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.174255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.174333] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.177595] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.177595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.177595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.177595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.177595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.177595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.177595] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-44494650-6b02-4361-a53d-fb11ecaa53f2 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.177595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.177595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.177595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.177595] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.177595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.177595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.177595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.178128] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.178161] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.178264] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44494650-6b02-4361-a53d-fb11ecaa53f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.638380] env[66994]: INFO networking_nsxv3.common.synchronization [None req-8e13352c-1938-41d4-a0d4-48b9dbd65e61 None None] Enqueued Resource ID: 2d055a83-69e9-4b20-a117-3fa1d785679e with Priority: HIGHEST for action port [ 763.638549] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d055a83-69e9-4b20-a117-3fa1d785679e with Priority: HIGHEST for action port [ 763.638856] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d055a83-69e9-4b20-a117-3fa1d785679e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.638973] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d055a83-69e9-4b20-a117-3fa1d785679e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.641988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d055a83-69e9-4b20-a117-3fa1d785679e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.641988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d055a83-69e9-4b20-a117-3fa1d785679e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.641988] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d055a83-69e9-4b20-a117-3fa1d785679e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.682161] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44494650-6b02-4361-a53d-fb11ecaa53f2: rpc.has_security_group_logging(os_id): False [ 763.703485] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.704280] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.704280] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.704280] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.704280] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.704479] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.704562] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.704633] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.704795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.704873] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.705068] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.705201] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.705298] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.705512] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.705633] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.705926] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.706680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.706680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.706872] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.706913] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.707384] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44494650-6b02-4361-a53d-fb11ecaa53f2 is going to be created. [ 763.772863] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.773101] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.773101] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.773492] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.773492] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.787255] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44494650-6b02-4361-a53d-fb11ecaa53f2 in Status: IN_PROGRESS for 2s [ 763.970721] env[66994]: INFO networking_nsxv3.common.synchronization [req-c40a9be5-023e-4531-a6e4-bf9be502d977 req-2d245a63-b2a9-4f1b-9e59-0faaa58fb453 tempest-ServerAddressesTestJSON-1610173527 tempest-ServerAddressesTestJSON-1610173527-project-member] Enqueued Resource ID: 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 with Priority: HIGHEST for action security_group_members [ 763.971739] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 with Priority: HIGHEST for action security_group_members [ 763.971739] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.971739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.971739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.972226] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.972226] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.972226] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.972226] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.972403] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.972403] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.973178] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6baaaeee-6f37-42ba-b9d6-0bcd943f91e5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.142662] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d055a83-69e9-4b20-a117-3fa1d785679e [ 764.143380] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.143380] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.143380] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.144046] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.144046] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.144046] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d055a83-69e9-4b20-a117-3fa1d785679e already deleted. [ 764.144046] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d055a83-69e9-4b20-a117-3fa1d785679e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.316669] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: SUCCESS [ 764.317013] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.317280] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.317655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.317783] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.317842] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.317876] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.318165] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.318233] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.318353] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.457300] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: SUCCESS [ 764.457300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.457300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.457300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.457300] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.457300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.457300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.457300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.457300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.457878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.457878] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.457878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.457878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.458382] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.458475] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.458615] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.458711] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.458902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.459292] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.459292] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.459292] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.477912] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.478156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.478234] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.478443] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.478542] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.478820] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.479046] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.479046] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.479258] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.479341] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.479432] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 is going to be updated. [ 764.519080] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.519080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.519080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.519080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.519722] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.533852] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 in Status: IN_PROGRESS for 2s [ 764.821986] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.822260] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.822327] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.822552] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.823836] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.823836] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.823836] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.823836] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.823836] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.823836] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.823836] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 is going to be updated. [ 764.869025] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.869025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.869025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.869025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.869025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.886431] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: IN_PROGRESS for 2s [ 764.962778] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d46fc8e7-8fb5-4007-bec6-48eb732825b5: rpc.has_security_group_logging(os_id): False [ 764.992754] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.993082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.993082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.993315] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.993415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.993666] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.993839] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.993839] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.995146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.995146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.995146] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.995146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.995146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.995146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.995146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.995146] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.995505] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.995505] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.995566] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.995663] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.995717] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 is going to be updated. [ 765.070082] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.070652] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.070848] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.071285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.071768] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.091770] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: IN_PROGRESS for 2s [ 765.611135] env[66994]: INFO networking_nsxv3.common.synchronization [None req-b39cb150-4d00-440a-8eda-9bb03d7dfb25 None None] Enqueued Resource ID: 8fca4db3-5382-4ee5-86a6-580ba9fae0be with Priority: HIGHEST for action port [ 765.611887] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fca4db3-5382-4ee5-86a6-580ba9fae0be with Priority: HIGHEST for action port [ 765.615198] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fca4db3-5382-4ee5-86a6-580ba9fae0be taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.615431] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fca4db3-5382-4ee5-86a6-580ba9fae0be" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.615552] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fca4db3-5382-4ee5-86a6-580ba9fae0be" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.615944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fca4db3-5382-4ee5-86a6-580ba9fae0be" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.616094] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fca4db3-5382-4ee5-86a6-580ba9fae0be',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.802762] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44494650-6b02-4361-a53d-fb11ecaa53f2 in Status: SUCCESS [ 765.803012] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.120465] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8fca4db3-5382-4ee5-86a6-580ba9fae0be [ 766.121943] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.121943] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.121943] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.121943] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.121943] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.121943] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8fca4db3-5382-4ee5-86a6-580ba9fae0be already deleted. [ 766.122358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fca4db3-5382-4ee5-86a6-580ba9fae0be" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.203532] env[66994]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 766.203646] env[66994]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] NSXv3 Agent Agent loop - iteration:1 started [ 766.547223] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 in Status: SUCCESS [ 766.547223] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 deletion is rescheduled due to dependency. [ 766.547223] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.899292] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: SUCCESS [ 766.899630] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 deletion is rescheduled due to dependency. [ 766.899630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.899802] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.900036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.900251] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.900382] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.900495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.900619] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.900699] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.901170] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.110763] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: SUCCESS [ 767.112202] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.112767] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.113191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.116167] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.356387] env[66994]: INFO networking_nsxv3.common.synchronization [req-d3102586-f56d-4eaa-b8cc-be6cefc3f124 req-4af8d225-d430-4ecc-a1a2-893f7e3b3671 tempest-ServersTestManualDisk-463487739 tempest-ServersTestManualDisk-463487739-project-member] Enqueued Resource ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e with Priority: HIGHEST for action security_group_members [ 767.357134] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e with Priority: HIGHEST for action security_group_members [ 767.358317] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.358523] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.358661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.359013] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.359449] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.359449] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.359449] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.359743] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.359797] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.359984] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7c25236-fc58-43cd-bd73-8bca62dfbd5e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.404819] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.405064] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.405064] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.407037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.407037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.407531] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.407531] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.407531] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.409999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.409999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.409999] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 is going to be updated. [ 767.451175] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.451175] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.451175] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.451175] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.451175] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.461436] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: IN_PROGRESS for 2s [ 767.618955] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.619143] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.619220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.619571] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.619762] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.619870] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.619934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.620129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.620237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.620344] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.620440] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.864977] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.864977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.864977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.864977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.864977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.864977] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.864977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.864977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.864977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.864977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.864977] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e already deleted. [ 767.864977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.933711] env[66994]: INFO networking_nsxv3.common.synchronization [None req-9d3e41f7-a3a5-46cc-a1ee-4478591b5530 None None] Enqueued Resource ID: 3a5ddade-c49a-45ac-a1e3-47e819f62248 with Priority: HIGHEST for action port [ 767.934515] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a5ddade-c49a-45ac-a1e3-47e819f62248 with Priority: HIGHEST for action port [ 767.936469] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a5ddade-c49a-45ac-a1e3-47e819f62248 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.936469] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a5ddade-c49a-45ac-a1e3-47e819f62248" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.936469] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a5ddade-c49a-45ac-a1e3-47e819f62248" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.936469] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a5ddade-c49a-45ac-a1e3-47e819f62248" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.936469] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a5ddade-c49a-45ac-a1e3-47e819f62248',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.039624] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.039890] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-108" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.040024] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-108" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.040423] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-108" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.040734] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.040888] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.041149] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.042359] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.042359] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.042359] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.042359] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.042359] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.042359] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.042359] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.042359] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.042716] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.097556] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.097664] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.055 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 768.097731] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.097923] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-108" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.099281] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-e65c830b-ca21-4dad-aa7e-bac2cea9fd81 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.099572] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-e65c830b-ca21-4dad-aa7e-bac2cea9fd81" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.099742] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-e65c830b-ca21-4dad-aa7e-bac2cea9fd81" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.100526] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-e65c830b-ca21-4dad-aa7e-bac2cea9fd81" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.100526] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e65c830b-ca21-4dad-aa7e-bac2cea9fd81',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.123796] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.124078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.124146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.124404] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.124571] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.124680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.124743] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.124900] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.124988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.125184] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.125262] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.125355] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.125418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.125589] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.125748] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.125844] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.125905] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.126059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.126135] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.126218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.126310] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.334243] env[66994]: INFO networking_nsxv3.common.synchronization [req-a347cc6e-ac88-4627-b3bf-b73f1170076c req-57f74f7b-e430-41be-8e69-5c9640d5896b tempest-ServersTestJSON-587851554 tempest-ServersTestJSON-587851554-project-member] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 768.335615] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 768.336605] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.336904] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.337051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.337604] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.338454] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.338454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.338454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.338885] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.338885] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.339086] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.439737] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a5ddade-c49a-45ac-a1e3-47e819f62248 [ 768.439737] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.439737] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.439737] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.439737] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.439737] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.439737] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a5ddade-c49a-45ac-a1e3-47e819f62248 already deleted. [ 768.439737] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a5ddade-c49a-45ac-a1e3-47e819f62248" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.603502] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.604117] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.604117] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.604283] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.604672] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.604672] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port e65c830b-ca21-4dad-aa7e-bac2cea9fd81 not found, creating... [ 768.605066] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.605066] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.605233] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.605470] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.605595] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.606486] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.606731] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.606876] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.607148] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.607323] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.607496] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: e65c830b-ca21-4dad-aa7e-bac2cea9fd81 is going to be created. [ 768.629837] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d46fc8e7-8fb5-4007-bec6-48eb732825b5: rpc.has_security_group_logging(os_id): False [ 768.656032] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.656032] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.656032] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.656394] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.656394] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.657035] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.657035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.657035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.657230] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.657283] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.658113] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.658113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.658113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.658113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.658113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.658499] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.658499] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.658499] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.658674] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.658674] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.658765] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 is going to be updated. [ 768.661111] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.661352] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.661485] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.661803] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.662183] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.662423] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-e65c830b-ca21-4dad-aa7e-bac2cea9fd81" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.782400] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.782400] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.782400] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.782400] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.782400] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.815965] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: IN_PROGRESS for 2s [ 768.842954] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.311637] env[66994]: INFO networking_nsxv3.common.synchronization [req-d3102586-f56d-4eaa-b8cc-be6cefc3f124 req-5c6f2c8a-2721-4a23-bf68-13cc37ed7c48 service nova] Enqueued Resource ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e with Priority: HIGHEST for action security_group_rules [ 769.312398] env[66994]: INFO networking_nsxv3.common.synchronization [req-d3102586-f56d-4eaa-b8cc-be6cefc3f124 req-5c6f2c8a-2721-4a23-bf68-13cc37ed7c48 service nova] Enqueued Resource ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e with Priority: HIGHEST for action security_group_members [ 769.312660] env[66994]: INFO networking_nsxv3.common.synchronization [req-d3102586-f56d-4eaa-b8cc-be6cefc3f124 req-5c6f2c8a-2721-4a23-bf68-13cc37ed7c48 service nova] Enqueued Resource ID: e65c830b-ca21-4dad-aa7e-bac2cea9fd81 with Priority: HIGHEST for action port [ 769.316446] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e with Priority: HIGHEST for action security_group_rules [ 769.316835] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e with Priority: HIGHEST for action security_group_members [ 769.317988] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e65c830b-ca21-4dad-aa7e-bac2cea9fd81 with Priority: HIGHEST for action port [ 769.318484] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.318750] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.318918] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.319291] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.319386] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7c25236-fc58-43cd-bd73-8bca62dfbd5e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.320749] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.320882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.320946] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.322134] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.322589] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.322589] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.322702] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.323215] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.323215] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.323215] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7c25236-fc58-43cd-bd73-8bca62dfbd5e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.324389] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-e65c830b-ca21-4dad-aa7e-bac2cea9fd81 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.324389] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e65c830b-ca21-4dad-aa7e-bac2cea9fd81" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.324389] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e65c830b-ca21-4dad-aa7e-bac2cea9fd81" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.324389] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e65c830b-ca21-4dad-aa7e-bac2cea9fd81" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.324389] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e65c830b-ca21-4dad-aa7e-bac2cea9fd81',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.347200] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.470766] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: SUCCESS [ 769.471709] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 deletion is rescheduled due to dependency. [ 769.471709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.827365] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7c25236-fc58-43cd-bd73-8bca62dfbd5e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.829545] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.829736] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.830037] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e65c830b-ca21-4dad-aa7e-bac2cea9fd81 with status ACTIVE [ 769.830037] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.830219] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.830219] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.830423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.830517] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.830720] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.830781] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.830849] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.831018] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.831140] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.831656] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.831656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.831656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.831656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.831656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.832427] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e65c830b-ca21-4dad-aa7e-bac2cea9fd81 is going to be updated. [ 769.850299] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.850635] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.850635] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.850635] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.850806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.850806] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 769.854931] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.855316] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.855316] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.855513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.855513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.855636] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e65c830b-ca21-4dad-aa7e-bac2cea9fd81" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.886139] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.886586] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.886586] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.886858] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.887197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.891091] env[66994]: INFO networking_nsxv3.common.synchronization [req-344cf030-0e0a-48f8-948d-37d66f87c443 req-abfbaca5-d30b-425c-b9c7-8f3ec66f22e0 tempest-AttachInterfacesUnderV243Test-1857034108 tempest-AttachInterfacesUnderV243Test-1857034108-project-member] Enqueued Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_members [ 769.891559] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_members [ 769.891881] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d884cf8-f142-472b-a29a-26176fe2cf88 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.891995] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.892081] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.892337] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.892516] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.892622] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.892685] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.892838] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.892923] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.893031] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.921222] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 770.279175] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-119 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.279468] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-119" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.279664] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-119" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.281312] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-119" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.281312] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.281312] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.281312] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.281312] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.281928] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.281928] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 770.281928] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 770.282112] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 770.282281] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 770.282353] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 770.282476] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 770.282671] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 770.303634] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 770.303837] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 770.303980] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 770.304260] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-119" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.304572] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.304739] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.304868] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.305442] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.305646] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.334332] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7c25236-fc58-43cd-bd73-8bca62dfbd5e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.337255] env[66994]: INFO networking_nsxv3.common.synchronization [None req-91129090-55d8-48b3-8245-6995b0782db4 None None] Enqueued Resource ID: 3ee4e141-e563-496d-aed3-60f8bc40a511 with Priority: HIGHEST for action port [ 770.338494] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ee4e141-e563-496d-aed3-60f8bc40a511 with Priority: HIGHEST for action port [ 770.338621] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ee4e141-e563-496d-aed3-60f8bc40a511 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.338813] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ee4e141-e563-496d-aed3-60f8bc40a511" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.338887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ee4e141-e563-496d-aed3-60f8bc40a511" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.339281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ee4e141-e563-496d-aed3-60f8bc40a511" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.339430] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ee4e141-e563-496d-aed3-60f8bc40a511',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.395299] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.395491] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.395541] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.395762] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.395858] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.396082] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.396203] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.396349] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.396443] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.396520] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.396612] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 already deleted. [ 770.396691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.810995] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.810995] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.810995] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.810995] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.810995] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.810995] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b not found, creating... [ 770.810995] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.810995] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.810995] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.810995] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.810995] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.811761] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.811761] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.811761] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.811875] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.812241] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.812241] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b is going to be created. [ 770.837839] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.839373] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.839373] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.839373] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.839373] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.839373] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.841263] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.841263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.841263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.841263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.842049] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.842049] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e is going to be created. [ 770.844120] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: SUCCESS [ 770.844120] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.845573] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ee4e141-e563-496d-aed3-60f8bc40a511 [ 770.845765] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.845954] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.845954] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.846161] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.846246] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.846363] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ee4e141-e563-496d-aed3-60f8bc40a511 already deleted. [ 770.846428] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ee4e141-e563-496d-aed3-60f8bc40a511" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.882814] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.882814] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.882814] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.882814] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.882814] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.897862] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e in Status: UNINITIALIZED for 2s [ 771.555191] env[66994]: INFO networking_nsxv3.common.synchronization [req-796c3715-0fb2-4500-8bab-0af6329c877c req-f90e84ca-709e-4704-bca3-5d338db8fafd tempest-ServerMetadataTestJSON-1853818150 tempest-ServerMetadataTestJSON-1853818150-project-member] Enqueued Resource ID: 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 with Priority: HIGHEST for action security_group_members [ 771.555191] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 with Priority: HIGHEST for action security_group_members [ 771.555808] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.556130] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.556284] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.557350] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.558607] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.559073] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.559276] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.560261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.560261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.560817] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ffb70f8-4012-40ec-b9e7-bc37e90e6e70',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.680343] env[66994]: INFO networking_nsxv3.common.synchronization [req-344cf030-0e0a-48f8-948d-37d66f87c443 req-4bf313fa-3401-4008-bd1a-25e72592005d service nova] Enqueued Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_rules [ 771.680728] env[66994]: INFO networking_nsxv3.common.synchronization [req-344cf030-0e0a-48f8-948d-37d66f87c443 req-4bf313fa-3401-4008-bd1a-25e72592005d service nova] Enqueued Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_members [ 771.680728] env[66994]: INFO networking_nsxv3.common.synchronization [req-344cf030-0e0a-48f8-948d-37d66f87c443 req-4bf313fa-3401-4008-bd1a-25e72592005d service nova] Enqueued Resource ID: c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b with Priority: HIGHEST for action port [ 771.681850] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_rules [ 771.682210] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_members [ 771.682363] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b with Priority: HIGHEST for action port [ 771.682687] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d884cf8-f142-472b-a29a-26176fe2cf88 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.682832] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.682903] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.683141] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.683237] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.684331] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d884cf8-f142-472b-a29a-26176fe2cf88 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.684392] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.684428] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.684596] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.685025] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.685025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.685025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.688851] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.688985] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.689122] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.690330] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.690430] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.690430] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.691054] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.691054] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.931660] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 771.931792] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.063651] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.064340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.064438] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.064680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.064798] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.065145] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.065296] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.065370] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.065599] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.065638] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.065737] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 already deleted. [ 772.065821] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.117967] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-215 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.118195] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-215" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.118348] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-215" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.118692] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-215" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.119038] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.119175] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.120938] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.120938] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.120938] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.120938] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 772.120938] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 772.120938] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 772.120938] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 772.120938] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 772.120938] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 772.120938] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 772.145121] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 772.145506] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 772.145573] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 772.145745] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-215" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.146088] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-5fecd903-29eb-4af9-9e3a-153e9aceed66 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.146318] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-5fecd903-29eb-4af9-9e3a-153e9aceed66" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.146391] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-5fecd903-29eb-4af9-9e3a-153e9aceed66" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.146712] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-5fecd903-29eb-4af9-9e3a-153e9aceed66" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.146844] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fecd903-29eb-4af9-9e3a-153e9aceed66',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.193635] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d884cf8-f142-472b-a29a-26176fe2cf88 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.193902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.197967] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.200351] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b with status ACTIVE [ 772.200351] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.200351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.200351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.200351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.200351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.200583] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.200640] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.201075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.201075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.201194] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.201525] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.204234] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.204234] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.204234] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.204234] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.204234] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b is going to be updated. [ 772.229369] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.229500] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.229600] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.229884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.230085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.230291] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.652026] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.652026] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.652026] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.652026] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.652026] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.652026] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 5fecd903-29eb-4af9-9e3a-153e9aceed66 not found, creating... [ 772.652026] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.652026] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.652026] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.652026] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.652026] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.652922] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.652922] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.653908] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.654297] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.656207] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.656207] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 5fecd903-29eb-4af9-9e3a-153e9aceed66 is going to be created. [ 772.689504] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.689504] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.689504] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.690014] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.690438] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.690780] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-5fecd903-29eb-4af9-9e3a-153e9aceed66" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.705672] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.916905] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e in Status: SUCCESS [ 772.916905] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.916905] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.917235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.917507] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.917507] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.917674] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.917725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.917773] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.917880] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.917962] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7c25236-fc58-43cd-bd73-8bca62dfbd5e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.208504] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.210601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.210601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.210916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.210916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.210916] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 is going to be created. [ 773.240152] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.240303] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.241386] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.241386] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.241386] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.251672] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 in Status: UNINITIALIZED for 2s [ 773.421544] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7c25236-fc58-43cd-bd73-8bca62dfbd5e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.470338] env[66994]: INFO networking_nsxv3.common.synchronization [req-796c3715-0fb2-4500-8bab-0af6329c877c req-30af0da0-d9aa-4b73-8745-6b2b9797c444 service nova] Enqueued Resource ID: 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 with Priority: HIGHEST for action security_group_rules [ 773.470517] env[66994]: INFO networking_nsxv3.common.synchronization [req-796c3715-0fb2-4500-8bab-0af6329c877c req-30af0da0-d9aa-4b73-8745-6b2b9797c444 service nova] Enqueued Resource ID: 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 with Priority: HIGHEST for action security_group_members [ 773.470669] env[66994]: INFO networking_nsxv3.common.synchronization [req-796c3715-0fb2-4500-8bab-0af6329c877c req-30af0da0-d9aa-4b73-8745-6b2b9797c444 service nova] Enqueued Resource ID: 5fecd903-29eb-4af9-9e3a-153e9aceed66 with Priority: HIGHEST for action port [ 773.471322] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 with Priority: HIGHEST for action security_group_rules [ 773.471523] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 with Priority: HIGHEST for action security_group_members [ 773.471678] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fecd903-29eb-4af9-9e3a-153e9aceed66 with Priority: HIGHEST for action port [ 773.472274] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.474929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.474929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.474929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.474929] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ffb70f8-4012-40ec-b9e7-bc37e90e6e70',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.474929] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.474929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.474929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.474929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.474929] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.475470] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.475470] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.475470] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.475470] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.475586] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ffb70f8-4012-40ec-b9e7-bc37e90e6e70',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.476447] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fecd903-29eb-4af9-9e3a-153e9aceed66 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.476670] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fecd903-29eb-4af9-9e3a-153e9aceed66" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.476744] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fecd903-29eb-4af9-9e3a-153e9aceed66" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.476983] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fecd903-29eb-4af9-9e3a-153e9aceed66" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.477109] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fecd903-29eb-4af9-9e3a-153e9aceed66',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.832806] env[66994]: INFO networking_nsxv3.common.synchronization [None req-afe8d75d-cc2a-4012-ba12-3ca9cd87ccb4 None None] Enqueued Resource ID: 1ed1fa5a-6676-449d-8f17-962fb8f95967 with Priority: HIGHEST for action port [ 773.832806] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ed1fa5a-6676-449d-8f17-962fb8f95967 with Priority: HIGHEST for action port [ 773.833258] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ed1fa5a-6676-449d-8f17-962fb8f95967 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.833419] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ed1fa5a-6676-449d-8f17-962fb8f95967" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.833419] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ed1fa5a-6676-449d-8f17-962fb8f95967" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.833779] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ed1fa5a-6676-449d-8f17-962fb8f95967" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.833779] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ed1fa5a-6676-449d-8f17-962fb8f95967',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.871139] env[66994]: INFO networking_nsxv3.common.synchronization [None req-16fcc586-2f43-4dc9-a901-60644ccd014d None None] Enqueued Resource ID: 89bd8489-cfb3-435a-b50b-288669f3b868 with Priority: HIGHEST for action port [ 773.871986] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89bd8489-cfb3-435a-b50b-288669f3b868 with Priority: HIGHEST for action port [ 773.872773] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-89bd8489-cfb3-435a-b50b-288669f3b868 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.873050] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89bd8489-cfb3-435a-b50b-288669f3b868" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.873221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89bd8489-cfb3-435a-b50b-288669f3b868" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.873536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89bd8489-cfb3-435a-b50b-288669f3b868" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.873674] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89bd8489-cfb3-435a-b50b-288669f3b868',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.925948] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7c25236-fc58-43cd-bd73-8bca62dfbd5e: rpc.has_security_group_logging(os_id): False [ 773.945641] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.945641] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.945874] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.945931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.946011] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.946271] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.946405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.946469] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.946637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.946715] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.946824] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e is going to be created. [ 773.978633] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.978844] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.980427] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8ffb70f8-4012-40ec-b9e7-bc37e90e6e70',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.984022] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5fecd903-29eb-4af9-9e3a-153e9aceed66 with status ACTIVE [ 773.984022] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.984022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.984022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.984022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.984022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.984022] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.984022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.984022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.984022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.984022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.984022] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.984022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.984022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.984022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.984022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.984022] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5fecd903-29eb-4af9-9e3a-153e9aceed66 is going to be updated. [ 774.007364] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.007364] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.007364] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.007618] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.007686] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.007849] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fecd903-29eb-4af9-9e3a-153e9aceed66" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.026653] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.026801] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.026867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.027116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.027597] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.044722] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e in Status: IN_PROGRESS for 2s [ 774.336918] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ed1fa5a-6676-449d-8f17-962fb8f95967 [ 774.338556] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.338556] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.338556] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.338556] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.338556] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.338556] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ed1fa5a-6676-449d-8f17-962fb8f95967 already deleted. [ 774.338556] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ed1fa5a-6676-449d-8f17-962fb8f95967" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.376029] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89bd8489-cfb3-435a-b50b-288669f3b868 [ 774.376542] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.376793] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.376888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.377391] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.377391] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.377586] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89bd8489-cfb3-435a-b50b-288669f3b868 already deleted. [ 774.377684] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89bd8489-cfb3-435a-b50b-288669f3b868" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.487221] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8ffb70f8-4012-40ec-b9e7-bc37e90e6e70',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.990479] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.990867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.990867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.990964] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.991008] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.991253] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 is going to be created. [ 775.026042] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.026309] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.026309] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.026745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.026745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.046294] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 in Status: UNINITIALIZED for 2s [ 775.264602] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 in Status: SUCCESS [ 775.264837] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.265017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.265389] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.265645] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.265718] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.265758] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.265925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.266024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.266104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.266254] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.769100] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.062137] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e in Status: SUCCESS [ 776.062504] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.271532] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d884cf8-f142-472b-a29a-26176fe2cf88: rpc.has_security_group_logging(os_id): False [ 776.299249] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.299249] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.299249] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.299249] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.299249] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.299249] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.299590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.299590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.299590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.299677] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.299713] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 is going to be created. [ 776.381360] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.381520] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.381595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.381826] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.382433] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.395615] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 in Status: IN_PROGRESS for 2s [ 776.995191] env[66994]: INFO networking_nsxv3.common.synchronization [req-c7a74278-b386-4c36-b1bf-2962576bb4e2 req-96799a74-f94b-4f27-9f28-a0a2d487f853 tempest-MultipleCreateTestJSON-651107876 tempest-MultipleCreateTestJSON-651107876-project-member] Enqueued Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 776.996076] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 777.000489] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.000668] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.000710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.000931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.001188] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.001284] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.001284] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.001414] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.001499] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.001598] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.060240] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 in Status: SUCCESS [ 777.060477] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.061070] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.061262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.061462] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.061582] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.061646] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.061798] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.061887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.061977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.062119] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ffb70f8-4012-40ec-b9e7-bc37e90e6e70',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.317648] env[66994]: INFO networking_nsxv3.common.synchronization [None req-768b65fb-63c2-4ecf-9761-e2694b287157 None None] Enqueued Resource ID: 5d018ca0-cba9-4b8b-ae23-9de95b753843 with Priority: HIGHEST for action port [ 777.318392] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d018ca0-cba9-4b8b-ae23-9de95b753843 with Priority: HIGHEST for action port [ 777.318709] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d018ca0-cba9-4b8b-ae23-9de95b753843 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.318837] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d018ca0-cba9-4b8b-ae23-9de95b753843" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.318904] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d018ca0-cba9-4b8b-ae23-9de95b753843" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.319306] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d018ca0-cba9-4b8b-ae23-9de95b753843" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.319354] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d018ca0-cba9-4b8b-ae23-9de95b753843',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.447188] env[66994]: INFO networking_nsxv3.common.synchronization [req-bdfb6ce6-04b4-43af-b434-74f6c4c63b01 req-4b68c140-b5ec-4d0a-a584-c8d8aa641de1 tempest-ImagesTestJSON-691407333 tempest-ImagesTestJSON-691407333-project-member] Enqueued Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 777.449505] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 777.450338] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.450338] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.450338] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.450910] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.450982] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.451319] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.451319] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.451695] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.451763] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.451944] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.504069] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.567822] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.567989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.568078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.568375] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.568556] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.568659] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.568723] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.568874] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.568965] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.569062] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.569210] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.569304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.569364] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.569502] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.569635] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.569723] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.569779] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.569912] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.569986] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.570085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.570173] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ffb70f8-4012-40ec-b9e7-bc37e90e6e70',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.637696] env[66994]: INFO networking_nsxv3.common.synchronization [req-c61cf772-04a8-43ab-8e2f-ea3eeee6beba req-1b401d95-0ee8-4939-94cf-db3e81573688 tempest-ServerRescueTestJSON-1208691686 tempest-ServerRescueTestJSON-1208691686-project-member] Enqueued Resource ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f with Priority: HIGHEST for action security_group_members [ 777.638347] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f with Priority: HIGHEST for action security_group_members [ 777.638625] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5a17dbe-38a0-49a6-88df-5879a5d5333f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.638947] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.640095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.640625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.641589] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.643240] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.643870] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.644179] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.644448] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.644448] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.825617] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d018ca0-cba9-4b8b-ae23-9de95b753843 [ 777.825617] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.825617] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.825617] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.825617] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.825617] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.825617] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d018ca0-cba9-4b8b-ae23-9de95b753843 already deleted. [ 777.825617] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d018ca0-cba9-4b8b-ae23-9de95b753843" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.957314] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.957514] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.957584] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.957788] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.957878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.958099] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.958409] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.958562] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.959286] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.959286] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.959286] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e already deleted. [ 777.959286] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.007887] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.032314] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-744 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.032667] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-744" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.032667] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-744" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.032931] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-744" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.033207] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.033361] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.033656] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.033656] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.033789] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.033986] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 778.034155] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 778.034322] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 778.034464] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 778.034589] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 778.034803] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 778.034803] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 778.060728] env[66994]: INFO networking_nsxv3.common.synchronization [req-5c467909-0474-48a4-9378-9c0fb3087c03 req-e021c7c1-f500-4dfd-b728-e52288c83532 tempest-MultipleCreateTestJSON-651107876 tempest-MultipleCreateTestJSON-651107876-project-member] Enqueued Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 778.061526] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGHEST for action security_group_members [ 778.062531] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.062531] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.072925] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70: rpc.has_security_group_logging(os_id): False [ 778.085426] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 778.085664] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.051 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 778.085806] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 778.086081] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-744" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.086417] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-f7884bfd-e87b-4067-aedb-948844921584 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.086636] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-f7884bfd-e87b-4067-aedb-948844921584" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.086756] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-f7884bfd-e87b-4067-aedb-948844921584" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.087154] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-f7884bfd-e87b-4067-aedb-948844921584" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.087244] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7884bfd-e87b-4067-aedb-948844921584',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.106532] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.106696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.106800] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.107150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.107247] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.107531] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.107661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.107731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.107989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.108089] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.108275] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.108407] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.108569] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.108754] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.108834] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.109051] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.109154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.109196] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.109346] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.109455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.109487] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 is going to be created. [ 778.147448] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.211057] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.211057] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.211057] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.211057] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.211379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.244914] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 in Status: IN_PROGRESS for 2s [ 778.410957] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 in Status: SUCCESS [ 778.411327] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.511685] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.512745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.512745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.512745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.512745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.512745] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 is going to be updated. [ 778.552074] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.552074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.552074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.552074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.552074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.564546] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: IN_PROGRESS for 2s [ 778.590428] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.590685] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.590827] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.591145] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.591296] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.591477] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port f7884bfd-e87b-4067-aedb-948844921584 not found, creating... [ 778.591748] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.591921] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.592067] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.592415] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.592554] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.592857] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.593028] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.593144] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.593380] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.593509] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.593646] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: f7884bfd-e87b-4067-aedb-948844921584 is going to be created. [ 778.631557] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.631840] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.631968] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.632542] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.632778] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.633049] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-f7884bfd-e87b-4067-aedb-948844921584" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.650536] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.111634] env[66994]: INFO networking_nsxv3.common.synchronization [req-d2034a9b-1300-4a37-9d9e-ea332ac72391 req-dcdf23ac-bcfb-4e2e-968b-1b75edb33cf9 tempest-InstanceActionsNegativeTestJSON-2071449854 tempest-InstanceActionsNegativeTestJSON-2071449854-project-member] Enqueued Resource ID: 44494650-6b02-4361-a53d-fb11ecaa53f2 with Priority: HIGHEST for action security_group_members [ 779.112612] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44494650-6b02-4361-a53d-fb11ecaa53f2 with Priority: HIGHEST for action security_group_members [ 779.112971] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-44494650-6b02-4361-a53d-fb11ecaa53f2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.113130] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.113202] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.113410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.113574] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.113678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.113767] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.113979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.113979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.114249] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44494650-6b02-4361-a53d-fb11ecaa53f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.156291] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.156637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.156637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.156843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.157022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.157147] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f is going to be updated. [ 779.198325] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.198475] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.198548] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.198817] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.198976] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.210140] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f in Status: IN_PROGRESS for 2s [ 779.389659] env[66994]: INFO networking_nsxv3.common.synchronization [req-bdfb6ce6-04b4-43af-b434-74f6c4c63b01 req-1e587223-68ec-4835-8418-9e8f4e759ef0 service nova] Enqueued Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_rules [ 779.389659] env[66994]: INFO networking_nsxv3.common.synchronization [req-bdfb6ce6-04b4-43af-b434-74f6c4c63b01 req-1e587223-68ec-4835-8418-9e8f4e759ef0 service nova] Enqueued Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 779.389659] env[66994]: INFO networking_nsxv3.common.synchronization [req-bdfb6ce6-04b4-43af-b434-74f6c4c63b01 req-1e587223-68ec-4835-8418-9e8f4e759ef0 service nova] Enqueued Resource ID: f7884bfd-e87b-4067-aedb-948844921584 with Priority: HIGHEST for action port [ 779.389659] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_rules [ 779.389659] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 779.389659] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7884bfd-e87b-4067-aedb-948844921584 with Priority: HIGHEST for action port [ 779.390590] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.390874] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.391213] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.391891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.392291] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.393477] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.395017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.395017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.395017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.395017] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.395017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.395017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.395017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.395017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.395017] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.396201] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7884bfd-e87b-4067-aedb-948844921584 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.396454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7884bfd-e87b-4067-aedb-948844921584" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.396603] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7884bfd-e87b-4067-aedb-948844921584" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.396846] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7884bfd-e87b-4067-aedb-948844921584" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.397911] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7884bfd-e87b-4067-aedb-948844921584',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.616474] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.616869] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.616869] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.616983] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.617181] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.617303] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.617437] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.617473] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.617618] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.617685] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.617773] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44494650-6b02-4361-a53d-fb11ecaa53f2 is going to be updated. [ 779.659017] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.659232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.659291] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.659535] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.659687] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.684072] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44494650-6b02-4361-a53d-fb11ecaa53f2 in Status: IN_PROGRESS for 2s [ 779.692216] env[66994]: INFO networking_nsxv3.common.synchronization [req-887e4491-8684-4cd4-bd53-d9f9eeff9ede req-740321ff-fe59-4d32-858c-5065dbf233e8 tempest-ListServersNegativeTestJSON-1189554403 tempest-ListServersNegativeTestJSON-1189554403-project-member] Enqueued Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_members [ 779.693258] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_members [ 779.693753] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdf001c-b425-433f-b4c2-dcd41fc81f02 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.693888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.693958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.694361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.694509] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.694661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.694713] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.694833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.694994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.694994] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.899954] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.901159] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.901297] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.901696] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7884bfd-e87b-4067-aedb-948844921584 with status ACTIVE [ 779.901865] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.901975] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.902048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.902278] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.902338] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.902504] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.902598] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.902658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.902809] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.902891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.904448] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.904448] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.904448] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.904448] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.904448] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.904790] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7884bfd-e87b-4067-aedb-948844921584 is going to be updated. [ 779.932662] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.932861] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.932861] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.933542] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.933760] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.933931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7884bfd-e87b-4067-aedb-948844921584" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.199076] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.266623] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 in Status: SUCCESS [ 780.266902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.402429] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.576607] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: SUCCESS [ 780.576607] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.576893] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.577131] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.577391] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.577531] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.577609] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.577798] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.577877] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.577977] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.702056] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.906079] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.906413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.906669] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.907398] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.907398] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.907398] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e is going to be created. [ 780.934660] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.934920] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.935156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.935456] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.935679] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.957022] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: UNINITIALIZED for 2s [ 781.082134] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.082134] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.082134] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.085417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.085417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.085417] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.085417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.085417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.085417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.085417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.085417] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 is going to be updated. [ 781.126485] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.128033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.128033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.128033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.128033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.142135] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: IN_PROGRESS for 2s [ 781.205220] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.205220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.205220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.205549] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.205669] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.205796] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 is going to be updated. [ 781.231189] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f in Status: SUCCESS [ 781.231404] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.260693] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.261550] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.263025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.263025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.263025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.275478] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 in Status: IN_PROGRESS for 2s [ 781.697690] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44494650-6b02-4361-a53d-fb11ecaa53f2 in Status: SUCCESS [ 781.697982] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44494650-6b02-4361-a53d-fb11ecaa53f2 deletion is rescheduled due to dependency. [ 781.698135] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.146310] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.146699] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.146766] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.147162] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.147342] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.651222] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.969934] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: SUCCESS [ 782.969934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.969934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.969934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.969934] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.969934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.969934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.969934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.969934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.969934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.970291] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.152978] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.162508] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 in Status: SUCCESS [ 783.162729] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 deletion is rescheduled due to dependency. [ 783.162863] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.288488] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 in Status: SUCCESS [ 783.288488] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.421579] env[66994]: INFO networking_nsxv3.common.synchronization [req-a3fdef50-1ea8-4799-b283-c769ae8b828d req-9f74faf9-749c-43f4-8139-32aa5cde23f6 tempest-ListServersNegativeTestJSON-1189554403 tempest-ListServersNegativeTestJSON-1189554403-project-member] Enqueued Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_members [ 783.422372] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGHEST for action security_group_members [ 783.422764] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fdf001c-b425-433f-b4c2-dcd41fc81f02 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.422912] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.422983] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.423216] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.423369] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.423487] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.423549] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.423702] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.423810] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.423906] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.472764] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.472965] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.473557] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.473557] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.473557] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.473557] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.473872] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.473872] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.473872] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.473991] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.474082] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.474233] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.474313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.474492] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.474634] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.474723] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.474787] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.474927] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.475009] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.475095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.475206] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.655650] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 783.655806] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 783.891847] env[66994]: INFO networking_nsxv3.common.synchronization [None req-ec22cbed-478d-4fc2-b182-3d811a364c3b None None] Enqueued Resource ID: bf7274a3-24e0-45ee-91b2-b40ec41623f6 with Priority: HIGHEST for action port [ 783.892429] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf7274a3-24e0-45ee-91b2-b40ec41623f6 with Priority: HIGHEST for action port [ 783.892704] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf7274a3-24e0-45ee-91b2-b40ec41623f6 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.892850] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf7274a3-24e0-45ee-91b2-b40ec41623f6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.892893] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf7274a3-24e0-45ee-91b2-b40ec41623f6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.893666] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf7274a3-24e0-45ee-91b2-b40ec41623f6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.893666] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf7274a3-24e0-45ee-91b2-b40ec41623f6',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.930369] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.930369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.930369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.930369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.930369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.930369] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.930369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.930369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.930369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.930369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.930369] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 is going to be updated. [ 783.969115] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.969356] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.969456] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.969833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.969970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.977414] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88bd36a2-b7c7-405c-ba4b-c36eb190f52e: rpc.has_security_group_logging(os_id): False [ 783.983312] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 in Status: IN_PROGRESS for 2s [ 783.986636] env[66994]: INFO networking_nsxv3.common.synchronization [req-8d1da53c-ac51-4c53-adbf-55abbccafdd8 req-4b517431-5b92-4496-8cea-ceb6942caa5f tempest-ImagesOneServerNegativeTestJSON-1432587522 tempest-ImagesOneServerNegativeTestJSON-1432587522-project-member] Enqueued Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_members [ 783.987188] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_members [ 783.987514] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-11c0b684-9731-4046-89ad-f4bf7b2168d4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.987667] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.987796] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.988032] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.988194] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.988297] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.988580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.988746] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.988836] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.988931] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.009186] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.009186] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.009186] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.009186] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.009186] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.009675] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.009907] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.010062] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.010317] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.010520] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.010802] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.011018] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.011193] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.011425] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.011582] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.011849] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.012060] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.012203] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.012552] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.012755] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.012972] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e is going to be created. [ 784.113275] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.113502] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.113502] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.114121] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.114121] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.129486] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: IN_PROGRESS for 2s [ 784.395212] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf7274a3-24e0-45ee-91b2-b40ec41623f6 [ 784.395740] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.397025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.397118] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.397376] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.397474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.397585] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf7274a3-24e0-45ee-91b2-b40ec41623f6 already deleted. [ 784.397671] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf7274a3-24e0-45ee-91b2-b40ec41623f6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.492562] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.492728] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.492800] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.493157] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.493258] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.493471] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.498250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.498250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.498250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.498250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.498250] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 is going to be updated. [ 784.533508] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.533694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.533752] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.533996] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.534270] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.548951] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 in Status: IN_PROGRESS for 2s [ 784.860312] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.860312] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.860312] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.860312] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.890075] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 784.893469] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.894369] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 784.931753] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.931753] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.931753] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.936822] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.943244] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.943661] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 784.943745] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 784.943833] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 785.002820] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.003109] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.003174] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.003415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.005305] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.007763] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 785.105971] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.105971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.105971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.108927] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.110331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.110714] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 785.120254] env[66994]: INFO networking_nsxv3.common.synchronization [req-b6c8b7a7-ce20-4f87-ba5d-8a42cb3fa4d7 req-1132b812-31be-4a83-a124-c8d384b8f873 tempest-ServerDiskConfigTestJSON-2121377508 tempest-ServerDiskConfigTestJSON-2121377508-project-member] Enqueued Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 785.120898] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 785.126318] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.126318] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.126318] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.126318] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.126318] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.126318] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.126318] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.126318] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.126318] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.126318] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.222573] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.223887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.223887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.223887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.223887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.223887] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:36. [ 785.223887] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'9ca0171b-7165-4d45-aa70-8fe66df074eb', '24a08da7-cf3b-41d4-b7f4-8e3b7616589e', 'e7c25236-fc58-43cd-bd73-8bca62dfbd5e', '6baaaeee-6f37-42ba-b9d6-0bcd943f91e5', 'cda947aa-81ac-4826-ab42-0806fdd02361', 'dbf01905-0f34-4b82-885d-141b364fdeab', 'bc9a0c95-f9f4-4eb7-a275-05d69816e71d', 'a5a17dbe-38a0-49a6-88df-5879a5d5333f', 'f2f71bab-7256-4f84-bd3c-ad2bf1145250', '5dbec57c-866e-4292-acf4-6de3635c21b3', '9108b2cc-cd11-4784-9282-52da311e05f1', '272acbad-bd3f-40f8-972f-dda18f503b74', 'd46fc8e7-8fb5-4007-bec6-48eb732825b5', 'fa1b7e95-7684-4712-b323-6d410e0e0d5b', 'dec0b14a-938b-49d8-be95-1b62d57e23e2', 'c80fb398-76b1-47f9-8bb6-a122061a01d6', '2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a', '605734aa-d0fb-486b-9d2a-22c70d9dd0ea', '34bde346-4da1-4dd8-ad15-cd1afe320304', '7176e416-370c-4ff8-be5b-5551a672ed01', '3ea9c700-dac6-4282-90b7-8b85af493263', '4fdf001c-b425-433f-b4c2-dcd41fc81f02', '11c0b684-9731-4046-89ad-f4bf7b2168d4', 'de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8', 'a6612b52-6412-47ab-8918-14b6b8bca0cb', '8ffb70f8-4012-40ec-b9e7-bc37e90e6e70', '2f159d71-0083-4a40-882f-2a28e3868c96', '44494650-6b02-4361-a53d-fb11ecaa53f2', '91e3865c-9322-423a-9d64-5c548ef52da8', 'd4672e8d-a5ca-46f8-8d7b-adf4da6e472b', '34a807f7-3865-4ec7-9af1-5f447e70423b', '52c814d2-8c46-4f11-a3ab-47d2b96480f7', 'aaddbb4b-3076-42ef-afd8-2dcbedf8773e', '841e623a-3249-4bd3-878a-817068626c8a', '5d884cf8-f142-472b-a29a-26176fe2cf88', '88bd36a2-b7c7-405c-ba4b-c36eb190f52e'} {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 785.223887] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 785.247738] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.250026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.250026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.250026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.250026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.250026] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 785.250026] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 785.250026] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 785.386761] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.387017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.387128] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.387413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.389660] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.390035] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 785.390189] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 785.390319] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 785.390442] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 785.390617] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/36 resources of Type:Security Group Rules [ 785.390730] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGH for action security_group_rules [ 785.390869] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGH for action security_group_rules [ 785.391380] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e with Priority: HIGH for action security_group_rules [ 785.391380] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 with Priority: HIGH for action security_group_rules [ 785.391380] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cda947aa-81ac-4826-ab42-0806fdd02361 with Priority: HIGH for action security_group_rules [ 785.391380] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dbf01905-0f34-4b82-885d-141b364fdeab with Priority: HIGH for action security_group_rules [ 785.392263] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d with Priority: HIGH for action security_group_rules [ 785.392421] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f with Priority: HIGH for action security_group_rules [ 785.392551] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f2f71bab-7256-4f84-bd3c-ad2bf1145250 with Priority: HIGH for action security_group_rules [ 785.392684] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGH for action security_group_rules [ 785.392814] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGH for action security_group_rules [ 785.392946] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 272acbad-bd3f-40f8-972f-dda18f503b74 with Priority: HIGH for action security_group_rules [ 785.393105] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGH for action security_group_rules [ 785.393241] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fa1b7e95-7684-4712-b323-6d410e0e0d5b with Priority: HIGH for action security_group_rules [ 785.393357] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dec0b14a-938b-49d8-be95-1b62d57e23e2 with Priority: HIGH for action security_group_rules [ 785.393467] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c80fb398-76b1-47f9-8bb6-a122061a01d6 with Priority: HIGH for action security_group_rules [ 785.393575] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a with Priority: HIGH for action security_group_rules [ 785.393689] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea with Priority: HIGH for action security_group_rules [ 785.393787] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 with Priority: HIGH for action security_group_rules [ 785.393900] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7176e416-370c-4ff8-be5b-5551a672ed01 with Priority: HIGH for action security_group_rules [ 785.394076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.629772] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.629772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.629772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.629772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.629772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.629772] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.629772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.629772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.629772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.629772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.629772] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 already deleted. [ 785.629772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.686024] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-172 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.686835] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-172" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.687141] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-172" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.687268] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-172" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.687626] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.687783] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.687908] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.688447] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.688618] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.688870] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.688973] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 785.689098] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 785.689201] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 785.689307] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.689407] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 785.689738] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 785.711420] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 785.711647] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 785.711741] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 785.711868] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-172" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.712201] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-2b876efe-9865-4927-bd32-0d604a8f64b2 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.712395] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-2b876efe-9865-4927-bd32-0d604a8f64b2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.712512] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-2b876efe-9865-4927-bd32-0d604a8f64b2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.712825] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-2b876efe-9865-4927-bd32-0d604a8f64b2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.712943] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b876efe-9865-4927-bd32-0d604a8f64b2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.994507] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 in Status: SUCCESS [ 785.994764] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 deletion is rescheduled due to dependency. [ 785.994807] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.141116] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: SUCCESS [ 786.141360] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.216047] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.216323] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.216508] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.216812] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.217016] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.217276] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 2b876efe-9865-4927-bd32-0d604a8f64b2 not found, creating... [ 786.217601] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.217783] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.217919] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.218230] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.218378] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.218729] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.218920] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.219056] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.219297] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.219461] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.219638] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 2b876efe-9865-4927-bd32-0d604a8f64b2 is going to be created. [ 786.242686] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.242924] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.243368] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.243368] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.243599] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.243827] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-2b876efe-9865-4927-bd32-0d604a8f64b2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.563033] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 in Status: SUCCESS [ 786.563175] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 deletion is rescheduled due to dependency. [ 786.563243] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.639226] env[66994]: INFO networking_nsxv3.common.synchronization [None req-1ffdfe88-c6ba-40e3-be02-0907ee968fb2 None None] Enqueued Resource ID: c10ec743-2816-4447-a687-c63a17b43dbc with Priority: HIGHEST for action port [ 786.639919] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c10ec743-2816-4447-a687-c63a17b43dbc with Priority: HIGHEST for action port [ 786.640094] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGH for action security_group_rules [ 786.640209] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e with Priority: HIGH for action security_group_rules [ 786.640444] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d with Priority: HIGH for action security_group_rules [ 786.640444] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dec0b14a-938b-49d8-be95-1b62d57e23e2 with Priority: HIGH for action security_group_rules [ 786.640599] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7176e416-370c-4ff8-be5b-5551a672ed01 with Priority: HIGH for action security_group_rules [ 786.640599] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 with Priority: HIGH for action security_group_rules [ 786.640802] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea with Priority: HIGH for action security_group_rules [ 786.640802] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a with Priority: HIGH for action security_group_rules [ 786.640802] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa1b7e95-7684-4712-b323-6d410e0e0d5b with Priority: HIGH for action security_group_rules [ 786.641032] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c80fb398-76b1-47f9-8bb6-a122061a01d6 with Priority: HIGH for action security_group_rules [ 786.641032] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 with Priority: HIGH for action security_group_rules [ 786.641032] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 272acbad-bd3f-40f8-972f-dda18f503b74 with Priority: HIGH for action security_group_rules [ 786.641150] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGH for action security_group_rules [ 786.641251] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGH for action security_group_rules [ 786.641334] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2f71bab-7256-4f84-bd3c-ad2bf1145250 with Priority: HIGH for action security_group_rules [ 786.641402] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf01905-0f34-4b82-885d-141b364fdeab with Priority: HIGH for action security_group_rules [ 786.641456] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f with Priority: HIGH for action security_group_rules [ 786.641529] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cda947aa-81ac-4826-ab42-0806fdd02361 with Priority: HIGH for action security_group_rules [ 786.641620] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGH for action security_group_rules [ 786.641697] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 with Priority: HIGH for action security_group_rules [ 786.642023] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-c10ec743-2816-4447-a687-c63a17b43dbc taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.642174] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c10ec743-2816-4447-a687-c63a17b43dbc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.642258] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c10ec743-2816-4447-a687-c63a17b43dbc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.642510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c10ec743-2816-4447-a687-c63a17b43dbc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.642586] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c10ec743-2816-4447-a687-c63a17b43dbc',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.644390] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.644511] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.644550] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.644742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.644820] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.646781] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.646781] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.646781] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.646781] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.646924] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7c25236-fc58-43cd-bd73-8bca62dfbd5e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.648898] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc9a0c95-f9f4-4eb7-a275-05d69816e71d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.649395] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.649470] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.649733] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.649835] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.651246] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dec0b14a-938b-49d8-be95-1b62d57e23e2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.651635] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.651635] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.651838] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.651929] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dec0b14a-938b-49d8-be95-1b62d57e23e2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.652772] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7176e416-370c-4ff8-be5b-5551a672ed01 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.653159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.653159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.653594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.653695] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7176e416-370c-4ff8-be5b-5551a672ed01',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.654840] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34bde346-4da1-4dd8-ad15-cd1afe320304 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.654840] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.654988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.655274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.655274] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34bde346-4da1-4dd8-ad15-cd1afe320304',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.656451] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605734aa-d0fb-486b-9d2a-22c70d9dd0ea taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.656616] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.656616] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.656747] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.656820] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605734aa-d0fb-486b-9d2a-22c70d9dd0ea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.659584] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.659748] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.659843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.660220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.660220] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.663223] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa1b7e95-7684-4712-b323-6d410e0e0d5b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.663385] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.663470] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.663763] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.663866] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa1b7e95-7684-4712-b323-6d410e0e0d5b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.665415] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c80fb398-76b1-47f9-8bb6-a122061a01d6 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.665563] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.665649] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.665905] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.666429] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c80fb398-76b1-47f9-8bb6-a122061a01d6',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.666873] env[66994]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 786.668742] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.669108] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.669194] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.669507] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.669695] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d46fc8e7-8fb5-4007-bec6-48eb732825b5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.671198] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-272acbad-bd3f-40f8-972f-dda18f503b74 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.671432] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.671539] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.671955] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.671955] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('272acbad-bd3f-40f8-972f-dda18f503b74',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.673627] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.674513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.674513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.674513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.674513] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.676029] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.677271] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.677271] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.677271] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.677271] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.678714] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2f71bab-7256-4f84-bd3c-ad2bf1145250 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.678714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.678714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.678919] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.679032] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2f71bab-7256-4f84-bd3c-ad2bf1145250',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.680541] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbf01905-0f34-4b82-885d-141b364fdeab taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.680685] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.680779] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.681246] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.681246] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbf01905-0f34-4b82-885d-141b364fdeab',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.682820] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5a17dbe-38a0-49a6-88df-5879a5d5333f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.682976] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.683084] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.683471] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.683582] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.685135] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cda947aa-81ac-4826-ab42-0806fdd02361 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.685278] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.685586] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.685586] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.685710] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cda947aa-81ac-4826-ab42-0806fdd02361',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.687281] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.687530] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.687609] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.687863] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.687966] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.689723] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.689939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.690089] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.690647] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.690647] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6baaaeee-6f37-42ba-b9d6-0bcd943f91e5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.690850] env[66994]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 786.727270] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.727270] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.727546] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.727726] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.931381] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5a17dbe-38a0-49a6-88df-5879a5d5333f taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.931605] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.931605] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.931696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.931855] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.931953] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.932023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.932233] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.932312] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.932398] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.932483] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.944313] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.944313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.944313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.944313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.944313] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.944313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.944313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.944313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.944313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.944756] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.944756] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.996416] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.996615] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.998146] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.998311] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.999735] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.999881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.000787] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.000938] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.001704] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.001826] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.002738] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.002908] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.003908] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.004078] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dec0b14a-938b-49d8-be95-1b62d57e23e2 is going to be deleted. [ 787.005095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.005395] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.007122] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.007260] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.029235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.030318] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6baaaeee-6f37-42ba-b9d6-0bcd943f91e5 is going to be deleted. [ 787.031446] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.033133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.040404] env[66994]: INFO networking_nsxv3.common.synchronization [req-b6c8b7a7-ce20-4f87-ba5d-8a42cb3fa4d7 req-257961fe-7228-428d-95cf-45f65ce4240b service nova] Enqueued Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_rules [ 787.040404] env[66994]: INFO networking_nsxv3.common.synchronization [req-b6c8b7a7-ce20-4f87-ba5d-8a42cb3fa4d7 req-257961fe-7228-428d-95cf-45f65ce4240b service nova] Enqueued Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 787.040404] env[66994]: INFO networking_nsxv3.common.synchronization [req-b6c8b7a7-ce20-4f87-ba5d-8a42cb3fa4d7 req-257961fe-7228-428d-95cf-45f65ce4240b service nova] Enqueued Resource ID: 2b876efe-9865-4927-bd32-0d604a8f64b2 with Priority: HIGHEST for action port [ 787.040949] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_rules [ 787.040949] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 787.041160] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b876efe-9865-4927-bd32-0d604a8f64b2 with Priority: HIGHEST for action port [ 787.041396] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.041537] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.041610] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.041858] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.041962] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.043659] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.043803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.043875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.044086] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.044357] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.044597] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.044663] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.044858] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.044999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.045116] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.046053] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b876efe-9865-4927-bd32-0d604a8f64b2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.046241] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b876efe-9865-4927-bd32-0d604a8f64b2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.046340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b876efe-9865-4927-bd32-0d604a8f64b2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.046528] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b876efe-9865-4927-bd32-0d604a8f64b2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.046599] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b876efe-9865-4927-bd32-0d604a8f64b2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.063546] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.063736] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605734aa-d0fb-486b-9d2a-22c70d9dd0ea is going to be deleted. [ 787.066143] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.066776] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.079542] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.079777] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.102636] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.102636] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 is going to be deleted. [ 787.103784] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.104275] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.106287] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.106410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.144978] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c10ec743-2816-4447-a687-c63a17b43dbc [ 787.145161] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.145353] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.145435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.145692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.145796] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.145927] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c10ec743-2816-4447-a687-c63a17b43dbc already deleted. [ 787.146017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c10ec743-2816-4447-a687-c63a17b43dbc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.146627] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.146770] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.146836] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.147015] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.148390] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.148511] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.148569] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.148746] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.149173] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.149173] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.149173] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.152539] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.152694] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2f71bab-7256-4f84-bd3c-ad2bf1145250 is going to be deleted. [ 787.154335] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.154487] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.154581] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.154794] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.154962] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.155122] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.155222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.155475] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.155580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.155677] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.155748] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.156763] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.156935] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.161257] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.161883] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.193617] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.193884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.193987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.194488] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.194717] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.194863] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.195404] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.196037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.196037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.196037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.196037] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7c25236-fc58-43cd-bd73-8bca62dfbd5e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.240151] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.240504] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.253296] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.253523] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.264449] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.264449] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d46fc8e7-8fb5-4007-bec6-48eb732825b5 is going to be deleted. [ 787.264449] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.264449] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.307766] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.307987] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa1b7e95-7684-4712-b323-6d410e0e0d5b is going to be deleted. [ 787.309478] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.309744] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.375089] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.375293] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.378726] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.378872] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a is going to be deleted. [ 787.379846] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.380091] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.380182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.380341] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dec0b14a-938b-49d8-be95-1b62d57e23e2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.380479] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.380640] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.380711] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.380820] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6baaaeee-6f37-42ba-b9d6-0bcd943f91e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.381806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.381977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.382077] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.382355] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605734aa-d0fb-486b-9d2a-22c70d9dd0ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.382532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.382721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.382771] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.382872] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.383038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.383164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.424470] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.424870] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.447179] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.451441] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.451597] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7176e416-370c-4ff8-be5b-5551a672ed01 is going to be deleted. [ 787.452729] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5a17dbe-38a0-49a6-88df-5879a5d5333f taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.452878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.452925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.455287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.455287] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.455287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.455287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.455287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.455287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.455287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.455287] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5a17dbe-38a0-49a6-88df-5879a5d5333f taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.455287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.455287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.455287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.455287] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.455287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.455287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.455287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.455287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.455287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.455287] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.457013] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.457013] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.457156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.457369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2f71bab-7256-4f84-bd3c-ad2bf1145250" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.458826] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.458941] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.458994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.459170] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.459349] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.459468] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.459531] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.459670] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.459743] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.459836] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.459987] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.462777] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.462777] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.462777] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.462777] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d46fc8e7-8fb5-4007-bec6-48eb732825b5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.464096] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-34bde346-4da1-4dd8-ad15-cd1afe320304 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.464245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.464312] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.464487] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.464647] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.464745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.464808] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.464948] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.465204] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.465204] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.465204] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34bde346-4da1-4dd8-ad15-cd1afe320304',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.478850] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.478983] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.478983] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.481544] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.481544] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.481544] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa1b7e95-7684-4712-b323-6d410e0e0d5b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.528922] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.528922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.528922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.529190] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.531061] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.531226] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.531967] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.534352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.535327] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.535462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.549318] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.549318] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.549318] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.552403] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.552403] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.552625] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b876efe-9865-4927-bd32-0d604a8f64b2 with status ACTIVE [ 787.552764] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.552826] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.552907] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.553358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.553358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.553358] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.553632] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.553632] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.553748] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.553748] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.553921] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.554028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.554103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.554446] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.554545] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.554682] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b876efe-9865-4927-bd32-0d604a8f64b2 is going to be updated. [ 787.587013] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.587214] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cda947aa-81ac-4826-ab42-0806fdd02361 is going to be deleted. [ 787.588428] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.588608] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.629251] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.629251] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.629251] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.629251] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.629650] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.629727] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b876efe-9865-4927-bd32-0d604a8f64b2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.661519] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.661896] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.661896] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.662019] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.662406] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.662678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.662763] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.663087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.663638] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.663638] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.663821] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.663821] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.663900] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.664103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.665235] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.665393] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.665512] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.665797] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.665876] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.665964] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.666100] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.667259] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.667466] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.667579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.667756] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.667998] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.668165] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.668225] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.668388] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.668440] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.668709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.669293] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.669293] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.669293] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.669293] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.669544] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.669544] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.669544] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.669733] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.669787] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.670962] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.670962] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.688115] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.688912] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 272acbad-bd3f-40f8-972f-dda18f503b74 is going to be deleted. [ 787.690295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.691102] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.699188] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7c25236-fc58-43cd-bd73-8bca62dfbd5e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.767015] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.767372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.784248] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.784409] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.785458] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.786107] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c80fb398-76b1-47f9-8bb6-a122061a01d6 is going to be deleted. [ 787.786570] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.786841] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.848423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.848582] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbf01905-0f34-4b82-885d-141b364fdeab is going to be deleted. [ 787.849629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.849881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.849982] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.850139] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e85f7fb-bdf5-4e3e-ac0f-caf198ab2c0a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.850331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.850569] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.850665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.850788] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7176e416-370c-4ff8-be5b-5551a672ed01" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.851661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.851661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.851661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.851817] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cda947aa-81ac-4826-ab42-0806fdd02361" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.863039] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.863566] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.863566] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.863566] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.863566] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.863770] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-272acbad-bd3f-40f8-972f-dda18f503b74" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.950128] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24a08da7-cf3b-41d4-b7f4-8e3b7616589e: rpc.has_security_group_logging(os_id): False [ 787.959615] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5a17dbe-38a0-49a6-88df-5879a5d5333f: rpc.has_security_group_logging(os_id): False [ 787.968304] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.968304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.968304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.968304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.968304] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.968304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.968304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.968304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.968304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.968304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.968304] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.968304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.968304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.968304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.968304] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.968304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.968878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.968878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.968878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.968878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.968878] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.968878] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34bde346-4da1-4dd8-ad15-cd1afe320304',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.013082] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.013082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.013082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.013082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.013082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.013082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c80fb398-76b1-47f9-8bb6-a122061a01d6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.032120] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.032678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.032678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.032678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.035449] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.035449] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.051392] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.072870] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.073085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.084402] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.084537] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.084606] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.084656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.084870] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.084953] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.085184] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.085306] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.085387] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.085546] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.085630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.085835] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.085911] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.085970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.086142] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.086215] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.086361] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f is going to be updated. [ 788.087668] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.087858] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.158741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.159333] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.159333] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.159333] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.159672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.159672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.159742] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e is going to be updated. [ 788.161069] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.161273] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.161364] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.161484] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbf01905-0f34-4b82-885d-141b364fdeab" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.171411] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc9a0c95-f9f4-4eb7-a275-05d69816e71d: rpc.has_security_group_logging(os_id): False [ 788.173166] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ca0171b-7165-4d45-aa70-8fe66df074eb: rpc.has_security_group_logging(os_id): False [ 788.203604] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7c25236-fc58-43cd-bd73-8bca62dfbd5e: rpc.has_security_group_logging(os_id): False [ 788.208291] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.208466] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.208520] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.209237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.212643] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.212767] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.256503] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.256503] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.264497] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.264911] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.265069] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.265139] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.265445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.265493] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.265968] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.266117] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.267147] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.267147] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.267147] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.267147] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.267147] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.267147] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.267576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.267576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.268364] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb is going to be updated. [ 788.269749] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.269749] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.346582] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.346849] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.382443] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.382825] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.383015] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.383139] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.383812] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.383812] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.383914] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.384048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.384095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.384333] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.384715] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.384961] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.387979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.388310] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.388641] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.388810] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.390842] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d is going to be updated. [ 788.390842] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.391187] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.425384] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.425522] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.437412] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.437890] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.437890] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.438029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.438327] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.438396] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.438502] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e is going to be updated. [ 788.440677] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.440945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.441284] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.442662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.442864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.443100] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.470752] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5dbec57c-866e-4292-acf4-6de3635c21b3: rpc.has_security_group_logging(os_id): False [ 788.472085] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34bde346-4da1-4dd8-ad15-cd1afe320304: rpc.has_security_group_logging(os_id): False [ 788.519374] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.519374] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.519534] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.519692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.521566] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.522325] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.531230] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: IN_PROGRESS for 2s [ 788.547551] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f in Status: IN_PROGRESS for 2s [ 788.554532] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.554739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.554804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.555379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.555379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.555547] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 is going to be created. [ 788.558552] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.558749] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.602405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.604490] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.604758] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.604758] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.604927] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.605019] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.605399] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.605517] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.605581] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.605822] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.605867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.606143] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.606239] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.606303] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.606453] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.606528] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.606635] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 is going to be updated. [ 788.607999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.608202] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.664797] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.664797] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.664797] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.664797] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.664797] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.666749] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.666922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.680692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.681960] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.681960] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.681960] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.681960] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.681960] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.682305] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 is going to be updated. [ 788.683973] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.684302] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.684513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.685897] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.686199] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.686676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.690221] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.690839] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.691046] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.691484] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.691793] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.696721] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: UNINITIALIZED for 2s [ 788.720646] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: IN_PROGRESS for 2s [ 788.730278] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d in Status: IN_PROGRESS for 2s [ 788.735453] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e in Status: IN_PROGRESS for 2s [ 788.791712] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.791914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.791958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.792311] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.792438] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.816730] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: IN_PROGRESS for 2s [ 788.928661] env[66994]: INFO networking_nsxv3.common.synchronization [None req-fc6388ef-391e-49ff-a22e-ae684299ea7d None None] Enqueued Resource ID: 4b37e5f2-fb9e-42c7-a55e-e146cbdd17a6 with Priority: HIGHEST for action port [ 788.929037] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b37e5f2-fb9e-42c7-a55e-e146cbdd17a6 with Priority: HIGHEST for action port [ 788.929407] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b37e5f2-fb9e-42c7-a55e-e146cbdd17a6 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.929532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b37e5f2-fb9e-42c7-a55e-e146cbdd17a6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.929643] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b37e5f2-fb9e-42c7-a55e-e146cbdd17a6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.929867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b37e5f2-fb9e-42c7-a55e-e146cbdd17a6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.929965] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b37e5f2-fb9e-42c7-a55e-e146cbdd17a6',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.996041] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.996041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.996041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.996041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.996041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.036947] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 in Status: IN_PROGRESS for 2s [ 789.433374] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b37e5f2-fb9e-42c7-a55e-e146cbdd17a6 [ 789.433629] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.434373] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.434507] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.434728] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.434825] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.434937] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b37e5f2-fb9e-42c7-a55e-e146cbdd17a6 already deleted. [ 789.435305] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b37e5f2-fb9e-42c7-a55e-e146cbdd17a6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.488019] env[66994]: INFO networking_nsxv3.common.synchronization [None req-3a718a69-7e02-47a8-a026-d249bf228857 tempest-AttachVolumeShelveTestJSON-810060241 tempest-AttachVolumeShelveTestJSON-810060241-project-member] Enqueued Resource ID: 0023a3cd-aa32-4af2-a423-608695d50731 with Priority: HIGHEST for action security_group_rules [ 789.488887] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0023a3cd-aa32-4af2-a423-608695d50731 with Priority: HIGHEST for action security_group_rules [ 789.488887] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0023a3cd-aa32-4af2-a423-608695d50731 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.495418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.495418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.495418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.495418] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0023a3cd-aa32-4af2-a423-608695d50731',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.662786] env[66994]: INFO networking_nsxv3.common.synchronization [None req-38208206-99d4-4811-8943-bb10e8ac24fd tempest-AttachVolumeShelveTestJSON-810060241 tempest-AttachVolumeShelveTestJSON-810060241-project-member] Enqueued Resource ID: 0023a3cd-aa32-4af2-a423-608695d50731 with Priority: HIGHEST for action security_group_rules [ 789.663420] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0023a3cd-aa32-4af2-a423-608695d50731 with Priority: HIGHEST for action security_group_rules [ 789.663745] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0023a3cd-aa32-4af2-a423-608695d50731 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.663844] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.066071] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.066071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.066071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.066599] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.066599] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.066599] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0023a3cd-aa32-4af2-a423-608695d50731 already deleted. [ 790.066599] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.066781] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.067072] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.067072] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0023a3cd-aa32-4af2-a423-608695d50731',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.550338] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: SUCCESS [ 790.550888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.574133] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f in Status: SUCCESS [ 790.574268] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.597535] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.597784] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.597784] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.598176] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.598343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.598467] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0023a3cd-aa32-4af2-a423-608695d50731 already deleted. [ 790.598561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.713596] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: SUCCESS [ 790.713803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.714025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.714339] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.714566] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.714697] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.714775] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.714942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.715077] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.715203] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.715276] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.744460] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: SUCCESS [ 790.744615] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.772760] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d in Status: SUCCESS [ 790.774358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.774358] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e in Status: SUCCESS [ 790.774358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.841248] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: SUCCESS [ 790.841520] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.056302] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 in Status: SUCCESS [ 791.056537] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.218865] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.222066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.222066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.222066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.222066] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.222066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.222066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.222066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.222066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.222066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.222066] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.222066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.222066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.222066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.222066] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.222066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.222066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.222066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.222066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.223310] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.223599] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.727749] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b62a4f35-964f-404b-ba36-70b4e8cb2dc5: rpc.has_security_group_logging(os_id): False [ 791.748801] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.748989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.748989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.749334] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.749390] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.749540] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.749735] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.749735] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.749976] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.750025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.750610] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.750610] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.750610] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.750610] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.752125] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.752125] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.752125] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.752125] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.752125] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.752125] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.752125] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 is going to be created. [ 791.840894] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.841115] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.841175] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.841532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.841731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.861030] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: IN_PROGRESS for 2s [ 792.071541] env[66994]: INFO networking_nsxv3.common.synchronization [None req-580aa2a9-caa3-420d-9e62-0ba7ae1c7a74 None None] Enqueued Resource ID: 9c8305c8-1c3b-4c81-a40d-20bbd1002646 with Priority: HIGHEST for action port [ 792.071913] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c8305c8-1c3b-4c81-a40d-20bbd1002646 with Priority: HIGHEST for action port [ 792.072406] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c8305c8-1c3b-4c81-a40d-20bbd1002646 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.072607] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c8305c8-1c3b-4c81-a40d-20bbd1002646" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.072722] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c8305c8-1c3b-4c81-a40d-20bbd1002646" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.073056] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c8305c8-1c3b-4c81-a40d-20bbd1002646" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.073213] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c8305c8-1c3b-4c81-a40d-20bbd1002646',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.576777] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c8305c8-1c3b-4c81-a40d-20bbd1002646 [ 792.577099] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.577200] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.577270] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.577628] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.577733] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.577842] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c8305c8-1c3b-4c81-a40d-20bbd1002646 already deleted. [ 792.577926] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c8305c8-1c3b-4c81-a40d-20bbd1002646" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.918432] env[66994]: INFO networking_nsxv3.common.synchronization [req-d253e7f7-1e1e-44b1-b6fe-c7dceeb5870d req-b81c9f74-8c73-4457-9185-ace8d5aa28cc tempest-VolumesAdminNegativeTest-455319634 tempest-VolumesAdminNegativeTest-455319634-project-member] Enqueued Resource ID: 2d27e4c7-d245-4441-888e-94841b693538 with Priority: HIGHEST for action security_group_members [ 792.919170] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d27e4c7-d245-4441-888e-94841b693538 with Priority: HIGHEST for action security_group_members [ 792.919333] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d27e4c7-d245-4441-888e-94841b693538 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.919457] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.919524] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.919774] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.919774] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.920048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.920098] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.920243] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.920320] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.920409] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d27e4c7-d245-4441-888e-94841b693538',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.422858] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.423103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.423103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.423297] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.423401] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.423632] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.423747] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.423810] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.423980] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.424072] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.424167] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d27e4c7-d245-4441-888e-94841b693538 already deleted. [ 793.424358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.446891] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-522 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.447122] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-522" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.447253] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-522" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.447584] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-522" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.447852] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.448051] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.448658] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.449067] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.449249] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.449504] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.449657] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 793.449720] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 793.449825] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 793.449934] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.450049] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 793.450182] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 793.473615] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 793.473812] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 793.473947] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 793.474314] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-522" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.474652] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-8becdb52-5a01-40b7-aa6a-01da15931d62 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.474830] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-8becdb52-5a01-40b7-aa6a-01da15931d62" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.474953] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-8becdb52-5a01-40b7-aa6a-01da15931d62" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.475368] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-8becdb52-5a01-40b7-aa6a-01da15931d62" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.475526] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8becdb52-5a01-40b7-aa6a-01da15931d62',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.878151] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: SUCCESS [ 793.878151] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.979568] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.979857] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.980107] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.980439] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.980636] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.980850] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 8becdb52-5a01-40b7-aa6a-01da15931d62 not found, creating... [ 793.981179] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.981352] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.981494] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.981783] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.981920] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.982298] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.982504] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.982602] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.982808] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.982936] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.983127] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 8becdb52-5a01-40b7-aa6a-01da15931d62 is going to be created. [ 794.009619] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.009994] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.010220] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.010674] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.010986] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.011355] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-8becdb52-5a01-40b7-aa6a-01da15931d62" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.787793] env[66994]: INFO networking_nsxv3.common.synchronization [req-d253e7f7-1e1e-44b1-b6fe-c7dceeb5870d req-b2d77649-fed2-432e-abc7-cdad23dd4f0e service nova] Enqueued Resource ID: 2d27e4c7-d245-4441-888e-94841b693538 with Priority: HIGHEST for action security_group_rules [ 794.787880] env[66994]: INFO networking_nsxv3.common.synchronization [req-d253e7f7-1e1e-44b1-b6fe-c7dceeb5870d req-b2d77649-fed2-432e-abc7-cdad23dd4f0e service nova] Enqueued Resource ID: 2d27e4c7-d245-4441-888e-94841b693538 with Priority: HIGHEST for action security_group_members [ 794.788101] env[66994]: INFO networking_nsxv3.common.synchronization [req-d253e7f7-1e1e-44b1-b6fe-c7dceeb5870d req-b2d77649-fed2-432e-abc7-cdad23dd4f0e service nova] Enqueued Resource ID: 8becdb52-5a01-40b7-aa6a-01da15931d62 with Priority: HIGHEST for action port [ 794.788719] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d27e4c7-d245-4441-888e-94841b693538 with Priority: HIGHEST for action security_group_rules [ 794.788885] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d27e4c7-d245-4441-888e-94841b693538 with Priority: HIGHEST for action security_group_members [ 794.789017] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8becdb52-5a01-40b7-aa6a-01da15931d62 with Priority: HIGHEST for action port [ 794.789435] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d27e4c7-d245-4441-888e-94841b693538 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.789696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.789765] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.790149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.790149] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d27e4c7-d245-4441-888e-94841b693538',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.791176] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d27e4c7-d245-4441-888e-94841b693538 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.791347] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.791347] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.791510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.791676] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.791757] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.791811] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.791959] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.792072] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.792157] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d27e4c7-d245-4441-888e-94841b693538',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.793430] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-8becdb52-5a01-40b7-aa6a-01da15931d62 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.793532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8becdb52-5a01-40b7-aa6a-01da15931d62" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.793601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8becdb52-5a01-40b7-aa6a-01da15931d62" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.795117] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8becdb52-5a01-40b7-aa6a-01da15931d62" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.795117] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8becdb52-5a01-40b7-aa6a-01da15931d62',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.155259] env[66994]: INFO networking_nsxv3.common.synchronization [req-a8c3cb0c-b108-47ae-8d1d-aeb0ad57a779 req-0fc39bdc-74d5-447f-a9b6-f1cba4cb9cf8 tempest-ListServerFiltersTestJSON-483871491 tempest-ListServerFiltersTestJSON-483871491-project-member] Enqueued Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_members [ 795.157084] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_members [ 795.157084] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.157084] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.157084] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.157084] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.157429] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.157429] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.157429] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.157571] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.157610] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.157709] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.295244] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d27e4c7-d245-4441-888e-94841b693538',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.296387] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d27e4c7-d245-4441-888e-94841b693538 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.296462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.296826] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8becdb52-5a01-40b7-aa6a-01da15931d62 with status ACTIVE [ 795.296986] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.299080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.299080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.299080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.299080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.299080] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.299080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.299080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.299080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.299080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.299080] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.299080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.299080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.299080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.299080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.299080] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8becdb52-5a01-40b7-aa6a-01da15931d62 is going to be updated. [ 795.329697] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.329892] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.329958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.330258] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.330613] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.330905] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8becdb52-5a01-40b7-aa6a-01da15931d62" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.663273] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.797949] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d27e4c7-d245-4441-888e-94841b693538',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.165281] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.301191] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.301559] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.301652] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.301907] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.302013] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.302132] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d27e4c7-d245-4441-888e-94841b693538 is going to be created. [ 796.331174] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.331346] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.331430] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.331655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.331873] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.344673] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d27e4c7-d245-4441-888e-94841b693538 in Status: UNINITIALIZED for 2s [ 796.669449] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.669449] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.669449] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.669917] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.669917] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.669917] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb is going to be updated. [ 796.712699] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.712699] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.712699] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.712699] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.712699] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.734398] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: IN_PROGRESS for 2s [ 798.359429] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d27e4c7-d245-4441-888e-94841b693538 in Status: SUCCESS [ 798.359718] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.360119] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.360119] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.360226] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.360435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.360435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.360575] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.360659] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.360742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.360837] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d27e4c7-d245-4441-888e-94841b693538',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.527032] env[66994]: INFO networking_nsxv3.common.synchronization [None req-f4d72ab5-bf9c-4361-9cd5-8d483f633661 None None] Enqueued Resource ID: 7f591d3e-3491-4cc5-9a48-07f721b16ea8 with Priority: HIGHEST for action port [ 798.527745] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f591d3e-3491-4cc5-9a48-07f721b16ea8 with Priority: HIGHEST for action port [ 798.528121] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f591d3e-3491-4cc5-9a48-07f721b16ea8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.528255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f591d3e-3491-4cc5-9a48-07f721b16ea8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.528316] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f591d3e-3491-4cc5-9a48-07f721b16ea8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.528747] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f591d3e-3491-4cc5-9a48-07f721b16ea8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.528747] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f591d3e-3491-4cc5-9a48-07f721b16ea8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.752407] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: SUCCESS [ 798.752806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.866361] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d27e4c7-d245-4441-888e-94841b693538 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.866361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.866361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.866361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.866361] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.866361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.866361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.866361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.866361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.866361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.866361] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d27e4c7-d245-4441-888e-94841b693538 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.866361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.866361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.866361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.866361] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.866361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.871608] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.871608] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.871608] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.871608] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.871608] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d27e4c7-d245-4441-888e-94841b693538',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.033544] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f591d3e-3491-4cc5-9a48-07f721b16ea8 [ 799.034944] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.034944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.034944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.034944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.034944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.034944] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f591d3e-3491-4cc5-9a48-07f721b16ea8 already deleted. [ 799.034944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f591d3e-3491-4cc5-9a48-07f721b16ea8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.373251] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d27e4c7-d245-4441-888e-94841b693538: rpc.has_security_group_logging(os_id): False [ 799.401343] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.401343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.401343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.401343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.401343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.401343] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.401343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.401343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.401343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.401343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.401343] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.401343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.401343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.401343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.401343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.402082] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.402082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.402082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.402082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.402082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.402082] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d27e4c7-d245-4441-888e-94841b693538 is going to be created. [ 799.498590] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.498590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.498590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.499852] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.499852] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.525980] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d27e4c7-d245-4441-888e-94841b693538 in Status: IN_PROGRESS for 2s [ 799.690668] env[66994]: INFO networking_nsxv3.common.synchronization [req-a465bb6c-73e3-4ab8-9961-1ff1fdfab04b req-3bab327c-ef9f-416c-b076-2c6bc064eee0 tempest-ServerRescueTestJSON-1208691686 tempest-ServerRescueTestJSON-1208691686-project-member] Enqueued Resource ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f with Priority: HIGHEST for action security_group_members [ 799.691271] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f with Priority: HIGHEST for action security_group_members [ 799.691621] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5a17dbe-38a0-49a6-88df-5879a5d5333f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.692804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.692804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.692804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.692804] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.692804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.692804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.692804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.692804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.692804] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.195548] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.195548] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.195707] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.195997] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.196165] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.196441] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.196747] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.196747] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.196899] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.196991] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.197116] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f is going to be updated. [ 800.235886] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.236085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.236167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.237053] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.237053] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.263022] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f in Status: IN_PROGRESS for 2s [ 801.413167] env[66994]: INFO networking_nsxv3.common.synchronization [None req-c20b762d-cc1d-45ed-9e62-391363347da0 None None] Enqueued Resource ID: d676728a-13c8-479b-85aa-d8efc5b51978 with Priority: HIGHEST for action port [ 801.415121] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d676728a-13c8-479b-85aa-d8efc5b51978 with Priority: HIGHEST for action port [ 801.415948] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-d676728a-13c8-479b-85aa-d8efc5b51978 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.416168] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d676728a-13c8-479b-85aa-d8efc5b51978" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.416168] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d676728a-13c8-479b-85aa-d8efc5b51978" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.416459] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d676728a-13c8-479b-85aa-d8efc5b51978" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.416459] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d676728a-13c8-479b-85aa-d8efc5b51978',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.543364] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d27e4c7-d245-4441-888e-94841b693538 in Status: SUCCESS [ 801.543364] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.918968] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d676728a-13c8-479b-85aa-d8efc5b51978 [ 801.919240] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.919377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.919447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.919657] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.919774] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.919835] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d676728a-13c8-479b-85aa-d8efc5b51978 already deleted. [ 801.919915] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d676728a-13c8-479b-85aa-d8efc5b51978" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.276529] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f in Status: SUCCESS [ 802.276529] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f deletion is rescheduled due to dependency. [ 802.276529] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.700278] env[66994]: INFO networking_nsxv3.common.synchronization [req-d9465a37-fa79-4844-b933-029340b4a196 req-eea88bb6-a480-4f8f-bd39-0d4ed27042b4 tempest-ServerMetadataTestJSON-1853818150 tempest-ServerMetadataTestJSON-1853818150-project-member] Enqueued Resource ID: 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 with Priority: HIGHEST for action security_group_members [ 802.701350] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 with Priority: HIGHEST for action security_group_members [ 802.701806] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.703383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.703383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.703383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.703383] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.703383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.703383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.703383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.703383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.703383] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ffb70f8-4012-40ec-b9e7-bc37e90e6e70',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.207103] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.207103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.207103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.207103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.245129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.245129] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.245129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.245129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.245129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.245129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.245129] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 is going to be updated. [ 803.286110] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.286110] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.286110] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.286110] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.286110] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.298270] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 in Status: IN_PROGRESS for 2s [ 805.310823] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 in Status: SUCCESS [ 805.311129] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 deletion is rescheduled due to dependency. [ 805.311202] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.133419] env[66994]: INFO networking_nsxv3.common.synchronization [req-bc502103-1072-4a9d-8b61-16d01d4d149f req-9a83ba2f-0f71-45df-96b0-e08f494c6efd tempest-ServersAdminTestJSON-1722983547 tempest-ServersAdminTestJSON-1722983547-project-member] Enqueued Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 807.133925] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 807.134300] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.134487] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.134487] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.134759] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.134827] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.134920] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.134988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.135136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.135229] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.135297] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.637920] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.140988] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.421113] env[66994]: INFO networking_nsxv3.common.synchronization [req-aa35aee3-4e6e-4e32-8851-63f2f8432d3c req-1349816d-06ec-48ad-9991-11bed6090aff tempest-ListImageFiltersTestJSON-572163632 tempest-ListImageFiltersTestJSON-572163632-project-member] Enqueued Resource ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e with Priority: HIGHEST for action security_group_members [ 808.422090] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e with Priority: HIGHEST for action security_group_members [ 808.422251] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.422251] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.422438] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.422540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.422694] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.422792] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.422866] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.422994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.423093] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.423190] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aaddbb4b-3076-42ef-afd8-2dcbedf8773e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.643094] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.643343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.643343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.643582] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.643688] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.643815] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 is going to be updated. [ 808.679969] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.679969] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.679969] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.679969] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.680256] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.690816] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: IN_PROGRESS for 2s [ 808.926876] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aaddbb4b-3076-42ef-afd8-2dcbedf8773e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.302648] env[66994]: INFO networking_nsxv3.common.synchronization [req-006ee385-26c0-4df1-95e4-4c784f799c72 req-0a6baf65-9c6a-4b0f-b5ef-fe979ae31eeb tempest-VolumesAdminNegativeTest-455319634 tempest-VolumesAdminNegativeTest-455319634-project-member] Enqueued Resource ID: 2d27e4c7-d245-4441-888e-94841b693538 with Priority: HIGHEST for action security_group_members [ 809.304209] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d27e4c7-d245-4441-888e-94841b693538 with Priority: HIGHEST for action security_group_members [ 809.305732] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d27e4c7-d245-4441-888e-94841b693538 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.305732] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.305732] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.305732] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.305898] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.305940] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.306331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.306589] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.306589] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.307184] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d27e4c7-d245-4441-888e-94841b693538',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.430125] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aaddbb4b-3076-42ef-afd8-2dcbedf8773e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.810549] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.810748] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.810795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.811016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.811121] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.811336] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.811438] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.811495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.811655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.811728] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.811814] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d27e4c7-d245-4441-888e-94841b693538 is going to be updated. [ 809.852348] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.852510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.852634] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.852790] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.852930] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.863233] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d27e4c7-d245-4441-888e-94841b693538 in Status: IN_PROGRESS for 2s [ 809.932191] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.932327] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.932327] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.932542] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.932638] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.932729] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e is going to be updated. [ 809.963809] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.963999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.964094] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.964305] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.964507] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.975787] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e in Status: IN_PROGRESS for 2s [ 810.701757] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: SUCCESS [ 810.701993] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.877713] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d27e4c7-d245-4441-888e-94841b693538 in Status: SUCCESS [ 811.878135] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d27e4c7-d245-4441-888e-94841b693538 deletion is rescheduled due to dependency. [ 811.878135] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.987765] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e in Status: SUCCESS [ 811.987989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.746672] env[66994]: INFO networking_nsxv3.common.synchronization [req-9fbe6646-18d2-4bb4-9f67-a7c705730d91 req-9d08ff3a-d2a4-4ea2-96da-45374756330e tempest-ServerDiskConfigTestJSON-2121377508 tempest-ServerDiskConfigTestJSON-2121377508-project-member] Enqueued Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 812.746672] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 812.746963] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.748106] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.748208] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.748437] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.748617] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.748725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.748800] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.749028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.749122] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.749229] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.253314] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.253770] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.253770] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.253770] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.253948] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.254104] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.254208] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.254269] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.254521] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.254610] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.254720] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 is going to be updated. [ 813.298079] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.298378] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.298378] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.298617] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.298812] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.313569] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: IN_PROGRESS for 2s [ 815.329633] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: SUCCESS [ 815.330103] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 deletion is rescheduled due to dependency. [ 815.330103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.353291] env[66994]: INFO networking_nsxv3.common.synchronization [req-7871a138-5ac5-4c3c-91fb-551d81867a92 req-c329e9f3-c073-400d-8709-7b76c3b99f0c tempest-ServersTestJSON-428956918 tempest-ServersTestJSON-428956918-project-member] Enqueued Resource ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 with Priority: HIGHEST for action security_group_members [ 816.354018] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 with Priority: HIGHEST for action security_group_members [ 816.355091] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-34bde346-4da1-4dd8-ad15-cd1afe320304 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.355091] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.355091] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.356259] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.356259] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.356259] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.356259] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.356259] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.356259] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.356259] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34bde346-4da1-4dd8-ad15-cd1afe320304',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.859348] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.859348] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.859348] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.859348] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.859348] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.859678] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.859733] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.859795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.859958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.860332] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.860332] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 is going to be updated. [ 816.920714] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.920714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.920714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.920714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.920714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.931689] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 in Status: IN_PROGRESS for 2s [ 816.964683] env[66994]: INFO networking_nsxv3.common.synchronization [req-48b81071-cccd-46a3-a5b8-f6670c816a06 req-960d6d22-18a6-4a81-826b-8e323b0cb25b tempest-ImagesTestJSON-691407333 tempest-ImagesTestJSON-691407333-project-member] Enqueued Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 816.965272] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 816.965592] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.965718] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.965782] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.965984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.966251] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.966251] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.966363] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.966459] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.966561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.966670] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.469207] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.471584] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.471584] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.471584] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.495220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.496992] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.496992] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.496992] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.496992] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.496992] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.496992] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e is going to be updated. [ 817.527624] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.527774] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.527851] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.528193] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.528373] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.539997] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: IN_PROGRESS for 2s [ 818.630165] env[66994]: INFO networking_nsxv3.common.synchronization [req-613cea1a-689f-464f-a278-bced9c9ab9ff req-e05f6aba-f4e8-4804-a675-9a47574c3afd tempest-AttachInterfacesUnderV243Test-1857034108 tempest-AttachInterfacesUnderV243Test-1857034108-project-member] Enqueued Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_members [ 818.630469] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_members [ 818.630857] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d884cf8-f142-472b-a29a-26176fe2cf88 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.631079] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.631746] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.631746] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.631746] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.631746] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.631746] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.632525] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.632525] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.632525] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.643599] env[66994]: INFO networking_nsxv3.common.synchronization [req-ccf7e700-0ce3-465c-848f-3e72222c1ee8 req-afeca224-6e76-4f77-8f2a-f6078289487b tempest-ServersWithSpecificFlavorTestJSON-500627254 tempest-ServersWithSpecificFlavorTestJSON-500627254-project-member] Enqueued Resource ID: a6612b52-6412-47ab-8918-14b6b8bca0cb with Priority: HIGHEST for action security_group_members [ 818.644667] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6612b52-6412-47ab-8918-14b6b8bca0cb with Priority: HIGHEST for action security_group_members [ 818.645091] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6612b52-6412-47ab-8918-14b6b8bca0cb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.649589] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.649682] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.649892] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.650084] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.650193] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.650256] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.650407] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.650491] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.650587] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6612b52-6412-47ab-8918-14b6b8bca0cb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.655994] env[66994]: INFO networking_nsxv3.common.synchronization [req-613cea1a-689f-464f-a278-bced9c9ab9ff req-e05f6aba-f4e8-4804-a675-9a47574c3afd tempest-AttachInterfacesUnderV243Test-1857034108 tempest-AttachInterfacesUnderV243Test-1857034108-project-member] Enqueued Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_rules [ 818.656176] env[66994]: INFO networking_nsxv3.common.synchronization [req-613cea1a-689f-464f-a278-bced9c9ab9ff req-e05f6aba-f4e8-4804-a675-9a47574c3afd tempest-AttachInterfacesUnderV243Test-1857034108 tempest-AttachInterfacesUnderV243Test-1857034108-project-member] Enqueued Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_members [ 818.656389] env[66994]: INFO networking_nsxv3.common.synchronization [req-613cea1a-689f-464f-a278-bced9c9ab9ff req-e05f6aba-f4e8-4804-a675-9a47574c3afd tempest-AttachInterfacesUnderV243Test-1857034108 tempest-AttachInterfacesUnderV243Test-1857034108-project-member] Enqueued Resource ID: c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b with Priority: HIGHEST for action port [ 818.656947] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_rules [ 818.657251] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_members [ 818.657251] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b with Priority: HIGHEST for action port [ 818.657984] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d884cf8-f142-472b-a29a-26176fe2cf88 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.658206] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.658522] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.658522] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.658776] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.659767] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d884cf8-f142-472b-a29a-26176fe2cf88 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.659858] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.660118] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.660268] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.660366] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.660571] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.660719] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.943871] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 in Status: SUCCESS [ 818.944181] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 deletion is rescheduled due to dependency. [ 818.944242] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.136432] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.154776] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.154919] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.154986] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.155218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.162728] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d884cf8-f142-472b-a29a-26176fe2cf88 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.162866] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.163048] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b with status ACTIVE [ 819.163213] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.163317] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.163382] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.163579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.163666] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.163833] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.163926] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.163984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.164208] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.164275] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.164397] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.164513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.164578] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.164717] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.164789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.164873] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b is going to be updated. [ 819.186064] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.186311] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.186441] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.186510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.186714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.187012] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.187012] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6612b52-6412-47ab-8918-14b6b8bca0cb is going to be updated. [ 819.206326] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.206326] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.206326] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.206326] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.206980] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.206980] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.227051] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.227599] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.227707] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.227925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.228088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.239326] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6612b52-6412-47ab-8918-14b6b8bca0cb in Status: IN_PROGRESS for 2s [ 819.567044] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: SUCCESS [ 819.567044] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e deletion is rescheduled due to dependency. [ 819.567044] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.639340] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.142610] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.142790] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.142867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.143134] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.143232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.143339] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 is going to be updated. [ 820.179827] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.179827] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.179827] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.179827] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.179827] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.196587] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 in Status: IN_PROGRESS for 2s [ 821.253666] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6612b52-6412-47ab-8918-14b6b8bca0cb in Status: SUCCESS [ 821.253666] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6612b52-6412-47ab-8918-14b6b8bca0cb deletion is rescheduled due to dependency. [ 821.253666] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.727775] env[66994]: INFO networking_nsxv3.common.synchronization [req-773f3171-6678-4b99-a0b6-15ec6425c479 req-0b1dbd98-f776-4b02-942d-af964a355c91 tempest-AttachInterfacesUnderV243Test-1857034108 tempest-AttachInterfacesUnderV243Test-1857034108-project-member] Enqueued Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_members [ 821.728436] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_members [ 821.728845] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d884cf8-f142-472b-a29a-26176fe2cf88 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.728967] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.742423] env[66994]: INFO networking_nsxv3.common.synchronization [req-773f3171-6678-4b99-a0b6-15ec6425c479 req-0b1dbd98-f776-4b02-942d-af964a355c91 tempest-AttachInterfacesUnderV243Test-1857034108 tempest-AttachInterfacesUnderV243Test-1857034108-project-member] Enqueued Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_rules [ 821.742684] env[66994]: INFO networking_nsxv3.common.synchronization [req-773f3171-6678-4b99-a0b6-15ec6425c479 req-0b1dbd98-f776-4b02-942d-af964a355c91 tempest-AttachInterfacesUnderV243Test-1857034108 tempest-AttachInterfacesUnderV243Test-1857034108-project-member] Enqueued Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_members [ 821.742853] env[66994]: INFO networking_nsxv3.common.synchronization [req-773f3171-6678-4b99-a0b6-15ec6425c479 req-0b1dbd98-f776-4b02-942d-af964a355c91 tempest-AttachInterfacesUnderV243Test-1857034108 tempest-AttachInterfacesUnderV243Test-1857034108-project-member] Enqueued Resource ID: c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b with Priority: HIGHEST for action port [ 821.743391] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_rules [ 821.743522] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_members [ 821.743627] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b with Priority: HIGHEST for action port [ 821.743908] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d884cf8-f142-472b-a29a-26176fe2cf88 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.744015] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.744720] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d884cf8-f142-472b-a29a-26176fe2cf88 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.744858] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.745066] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.745181] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.745246] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.745466] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.745551] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.206922] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 in Status: SUCCESS [ 822.207165] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.207337] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.207550] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.207738] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.207859] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.207921] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.208098] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.208183] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.208290] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.249641] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b with status ACTIVE [ 822.249641] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.249641] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.249641] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.249641] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.249641] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.249641] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.249641] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.249641] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.249641] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.249641] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.249641] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.249641] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.250285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.250285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.250285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.250285] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b is going to be updated. [ 822.271221] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.271221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.271626] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.271626] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.271857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.272110] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3b30fd0-f2b3-422a-9ead-8ab03fa59a8b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.710520] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.212894] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.716870] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.717197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.717197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.717424] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.720155] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.720279] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 is going to be updated. [ 823.764243] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.764385] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.764462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.764705] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.764860] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.775417] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 in Status: IN_PROGRESS for 2s [ 824.864073] env[66994]: INFO networking_nsxv3.common.synchronization [req-b1137d41-4678-41fb-a200-23ed42d5d13f req-1f5e206b-2e7a-423c-92a3-3dd0b1cbf3df tempest-ServersTestMultiNic-1223700725 tempest-ServersTestMultiNic-1223700725-project-member] Enqueued Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 824.865204] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 824.865989] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.865989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.865989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.865989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.866630] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.866630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.866630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.866630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.866630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.866630] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.152208] env[66994]: INFO networking_nsxv3.common.synchronization [req-b1137d41-4678-41fb-a200-23ed42d5d13f req-40a461c5-3e19-4511-86fa-9fdc08cbae8c tempest-ServersTestMultiNic-1223700725 tempest-ServersTestMultiNic-1223700725-project-member] Enqueued Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 825.152208] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 825.152577] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.152866] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.372450] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.372645] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.372645] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.373443] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.373443] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.373443] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.373443] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.373443] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.373744] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.373744] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.373809] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 is going to be deleted. [ 825.420989] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.421180] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.421267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.421644] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.421728] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.423407] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.423407] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.423407] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.423407] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.423407] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.423407] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.423407] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.423407] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.423407] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.611211] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-749 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.611386] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-749" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.611548] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-749" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.611900] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-749" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.612264] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.612546] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.612727] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.613201] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.613433] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.613691] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 825.613895] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 825.614085] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 825.615731] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 825.615938] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 825.616116] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 825.616517] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 825.642623] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 825.642623] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 825.642855] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 825.643955] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-749" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.643955] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-41bdba11-0662-4066-b444-70f87cacfbdf taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.643955] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-41bdba11-0662-4066-b444-70f87cacfbdf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.643955] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-41bdba11-0662-4066-b444-70f87cacfbdf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.644233] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-41bdba11-0662-4066-b444-70f87cacfbdf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.644373] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41bdba11-0662-4066-b444-70f87cacfbdf',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.787744] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 in Status: SUCCESS [ 825.788115] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.788291] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.788496] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.788682] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.788799] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.788863] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.789032] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.789112] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.789196] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.789293] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.790472] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.790643] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.790830] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.790910] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.790967] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.791883] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.791883] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.791883] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.926776] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.927312] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.927312] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.927312] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.927312] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.927602] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.927602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.927731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.927780] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.927838] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.927906] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 already deleted. [ 825.928237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.147095] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.147333] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.147581] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.147915] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.148087] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.148246] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 41bdba11-0662-4066-b444-70f87cacfbdf not found, creating... [ 826.148510] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.148670] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.148781] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.149010] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.149157] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.149436] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.149628] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.149702] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.149885] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.150020] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.150157] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 41bdba11-0662-4066-b444-70f87cacfbdf is going to be created. [ 826.166619] env[66994]: INFO networking_nsxv3.common.synchronization [req-3b9bdfa3-c6d1-4aaf-9103-f1f9d4914965 req-f327344e-3314-415e-bc0b-3e6350e10e24 tempest-AttachInterfacesUnderV243Test-1857034108 tempest-AttachInterfacesUnderV243Test-1857034108-project-member] Enqueued Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_members [ 826.167193] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 with Priority: HIGHEST for action security_group_members [ 826.167504] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d884cf8-f142-472b-a29a-26176fe2cf88 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.167602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.177080] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.177329] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.177392] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.177654] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.177882] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.178152] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-41bdba11-0662-4066-b444-70f87cacfbdf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.294367] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.295447] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.797188] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d884cf8-f142-472b-a29a-26176fe2cf88: rpc.has_security_group_logging(os_id): False [ 826.798377] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.818308] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.818308] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.818308] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.818308] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.843564] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.843564] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.843564] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.843564] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.843564] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.843564] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.843564] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 is going to be updated. [ 826.907030] env[66994]: INFO networking_nsxv3.common.synchronization [req-b1137d41-4678-41fb-a200-23ed42d5d13f req-cf142e88-5077-4581-b2f3-b74e900b6bdf service nova] Enqueued Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_rules [ 826.907030] env[66994]: INFO networking_nsxv3.common.synchronization [req-b1137d41-4678-41fb-a200-23ed42d5d13f req-cf142e88-5077-4581-b2f3-b74e900b6bdf service nova] Enqueued Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 826.907030] env[66994]: INFO networking_nsxv3.common.synchronization [req-b1137d41-4678-41fb-a200-23ed42d5d13f req-cf142e88-5077-4581-b2f3-b74e900b6bdf service nova] Enqueued Resource ID: 41bdba11-0662-4066-b444-70f87cacfbdf with Priority: HIGHEST for action port [ 826.907030] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_rules [ 826.907030] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 826.907030] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41bdba11-0662-4066-b444-70f87cacfbdf with Priority: HIGHEST for action port [ 826.907030] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.908387] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.908579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.909319] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.912043] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.912043] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.912043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.912043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.912043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.912043] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.912043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.912043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.912043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.912043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.912043] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.913740] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-41bdba11-0662-4066-b444-70f87cacfbdf taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.914604] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41bdba11-0662-4066-b444-70f87cacfbdf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.914604] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41bdba11-0662-4066-b444-70f87cacfbdf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.914604] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41bdba11-0662-4066-b444-70f87cacfbdf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.914604] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41bdba11-0662-4066-b444-70f87cacfbdf',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.916496] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.916651] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.916788] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.917501] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.918775] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.934980] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 in Status: IN_PROGRESS for 2s [ 827.304615] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.305597] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.305597] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.305597] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.305597] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.305597] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 is going to be updated. [ 827.338599] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.338870] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.339013] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.339360] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.339600] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.349833] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 in Status: IN_PROGRESS for 2s [ 827.421925] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.423250] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.423390] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.423552] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41bdba11-0662-4066-b444-70f87cacfbdf with status ACTIVE [ 827.423761] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.423871] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.423905] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.424164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.424255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.424459] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.424753] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.424823] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.424998] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.425054] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.425246] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.425358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.425420] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.425662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.426335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.426479] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41bdba11-0662-4066-b444-70f87cacfbdf is going to be updated. [ 827.453238] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.453238] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.453238] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.453548] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.453604] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.453803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41bdba11-0662-4066-b444-70f87cacfbdf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.723229] env[66994]: INFO networking_nsxv3.common.synchronization [req-34a0fa23-69fb-403a-9bac-5e7bd02cbc1e req-84f74efe-e341-46f9-af89-ce5b7763c75d tempest-ServerTagsTestJSON-338534640 tempest-ServerTagsTestJSON-338534640-project-member] Enqueued Resource ID: 33070768-249a-4c90-b087-54185820f170 with Priority: HIGHEST for action security_group_members [ 827.723796] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33070768-249a-4c90-b087-54185820f170 with Priority: HIGHEST for action security_group_members [ 827.724142] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-33070768-249a-4c90-b087-54185820f170 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.724273] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.724341] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.724673] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.724825] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.724928] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.724989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.725163] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.725248] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.725343] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33070768-249a-4c90-b087-54185820f170',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.735116] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-366 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.735426] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-366" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.735623] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-366" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.736298] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-366" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.737196] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.737196] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.737196] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.737757] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.737757] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.737886] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 827.738087] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 827.738328] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 827.738528] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 827.738723] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 827.738911] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 827.739161] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 827.767811] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 827.768126] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 827.768370] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 827.768690] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-366" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.769184] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-65210a95-6f7d-46cc-b276-2daa8ebefef6 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.769472] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-65210a95-6f7d-46cc-b276-2daa8ebefef6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.769701] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-65210a95-6f7d-46cc-b276-2daa8ebefef6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.770194] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-65210a95-6f7d-46cc-b276-2daa8ebefef6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.770436] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65210a95-6f7d-46cc-b276-2daa8ebefef6',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.928745] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.102924] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-649 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.103289] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-649" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.103403] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-649" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.103768] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-649" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.104125] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.104373] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.104547] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.104793] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.104954] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.105208] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.105378] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 828.105590] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 828.105782] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 828.105913] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.106035] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.106167] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.135858] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.135974] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 828.136194] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.136433] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-649" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.136872] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-488a6d2c-cf42-40ee-ab99-ba41d4e437df taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.137142] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-488a6d2c-cf42-40ee-ab99-ba41d4e437df" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.137314] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-488a6d2c-cf42-40ee-ab99-ba41d4e437df" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.137758] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-488a6d2c-cf42-40ee-ab99-ba41d4e437df" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.137958] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('488a6d2c-cf42-40ee-ab99-ba41d4e437df',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.228084] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.228529] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.228529] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.228529] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.228529] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.228774] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.228774] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.228921] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.228985] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.229076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.229139] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33070768-249a-4c90-b087-54185820f170 already deleted. [ 828.229221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.274167] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.274167] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.274422] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.274651] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.274913] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.275196] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 65210a95-6f7d-46cc-b276-2daa8ebefef6 not found, creating... [ 828.275633] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.275894] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.276117] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.276489] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.276708] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.277205] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.277460] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.277665] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.277999] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.278242] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.278478] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 65210a95-6f7d-46cc-b276-2daa8ebefef6 is going to be created. [ 828.306493] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.306912] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.306912] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.307206] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.307436] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.307660] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-65210a95-6f7d-46cc-b276-2daa8ebefef6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.431806] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.432084] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.432162] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.432411] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.432520] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.432635] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 is going to be created. [ 828.468853] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.468955] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.468955] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.469187] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.469357] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.481247] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: UNINITIALIZED for 2s [ 828.641598] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.641796] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.641875] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.642201] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.642348] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.642505] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 488a6d2c-cf42-40ee-ab99-ba41d4e437df not found, creating... [ 828.643561] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.643843] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.644027] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.644312] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.644690] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.645040] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.645210] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.645341] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.645620] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.645725] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.645863] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 488a6d2c-cf42-40ee-ab99-ba41d4e437df is going to be created. [ 828.669462] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.669744] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.669953] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.670299] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.670614] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.670903] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-488a6d2c-cf42-40ee-ab99-ba41d4e437df" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.949470] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 in Status: SUCCESS [ 828.949656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.949832] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.951012] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.951012] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.021421] env[66994]: INFO networking_nsxv3.common.synchronization [req-b1137d41-4678-41fb-a200-23ed42d5d13f req-4485e011-e596-427c-b8b6-4b608345f037 service nova] Enqueued Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_rules [ 829.021599] env[66994]: INFO networking_nsxv3.common.synchronization [req-b1137d41-4678-41fb-a200-23ed42d5d13f req-4485e011-e596-427c-b8b6-4b608345f037 service nova] Enqueued Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 829.021734] env[66994]: INFO networking_nsxv3.common.synchronization [req-b1137d41-4678-41fb-a200-23ed42d5d13f req-4485e011-e596-427c-b8b6-4b608345f037 service nova] Enqueued Resource ID: 65210a95-6f7d-46cc-b276-2daa8ebefef6 with Priority: HIGHEST for action port [ 829.022294] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_rules [ 829.022449] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 829.022574] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65210a95-6f7d-46cc-b276-2daa8ebefef6 with Priority: HIGHEST for action port [ 829.022856] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.022958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.023167] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.023247] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.023622] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-65210a95-6f7d-46cc-b276-2daa8ebefef6 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.023622] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65210a95-6f7d-46cc-b276-2daa8ebefef6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.023622] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65210a95-6f7d-46cc-b276-2daa8ebefef6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.023780] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65210a95-6f7d-46cc-b276-2daa8ebefef6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.023845] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65210a95-6f7d-46cc-b276-2daa8ebefef6',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.362987] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 in Status: SUCCESS [ 829.363286] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.363414] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.363628] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.363821] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.363939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.364018] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.365377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.365532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.365681] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.372949] env[66994]: INFO networking_nsxv3.common.synchronization [req-34a0fa23-69fb-403a-9bac-5e7bd02cbc1e req-408d049b-1472-42d1-9273-be911f1c5950 service nova] Enqueued Resource ID: 33070768-249a-4c90-b087-54185820f170 with Priority: HIGHEST for action security_group_rules [ 829.373135] env[66994]: INFO networking_nsxv3.common.synchronization [req-34a0fa23-69fb-403a-9bac-5e7bd02cbc1e req-408d049b-1472-42d1-9273-be911f1c5950 service nova] Enqueued Resource ID: 33070768-249a-4c90-b087-54185820f170 with Priority: HIGHEST for action security_group_members [ 829.373287] env[66994]: INFO networking_nsxv3.common.synchronization [req-34a0fa23-69fb-403a-9bac-5e7bd02cbc1e req-408d049b-1472-42d1-9273-be911f1c5950 service nova] Enqueued Resource ID: 488a6d2c-cf42-40ee-ab99-ba41d4e437df with Priority: HIGHEST for action port [ 829.373791] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33070768-249a-4c90-b087-54185820f170 with Priority: HIGHEST for action security_group_rules [ 829.374207] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33070768-249a-4c90-b087-54185820f170 with Priority: HIGHEST for action security_group_members [ 829.376106] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 488a6d2c-cf42-40ee-ab99-ba41d4e437df with Priority: HIGHEST for action port [ 829.376106] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33070768-249a-4c90-b087-54185820f170 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.376106] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.376106] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.376106] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.376340] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33070768-249a-4c90-b087-54185820f170',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.380059] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-33070768-249a-4c90-b087-54185820f170 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.380059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.380059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.380059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.380059] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.380059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.380059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.380059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.380059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.380059] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33070768-249a-4c90-b087-54185820f170',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.382041] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-488a6d2c-cf42-40ee-ab99-ba41d4e437df taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.382041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-488a6d2c-cf42-40ee-ab99-ba41d4e437df" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.382041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-488a6d2c-cf42-40ee-ab99-ba41d4e437df" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.382041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-488a6d2c-cf42-40ee-ab99-ba41d4e437df" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.382308] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('488a6d2c-cf42-40ee-ab99-ba41d4e437df',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.479050] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.479050] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.479050] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.479050] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.479050] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.479050] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 is going to be deleted. [ 829.526064] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65210a95-6f7d-46cc-b276-2daa8ebefef6 with status ACTIVE [ 829.526387] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.526540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.526617] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.526863] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.526948] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.527343] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.527343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.527574] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.527574] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.527651] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.527824] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.527967] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.528076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.528164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.528244] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.530333] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65210a95-6f7d-46cc-b276-2daa8ebefef6 is going to be updated. [ 829.550286] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.550456] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.550509] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.550684] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.550769] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.550888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.555040] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.555194] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.555246] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.555427] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.555600] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.555791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65210a95-6f7d-46cc-b276-2daa8ebefef6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.872896] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.873111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.873111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.873347] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.873440] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.873673] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.873751] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.873788] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.873938] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.874025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.874121] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 is going to be deleted. [ 829.885255] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-33070768-249a-4c90-b087-54185820f170 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.885407] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.885656] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 488a6d2c-cf42-40ee-ab99-ba41d4e437df with status ACTIVE [ 829.885876] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.885995] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.886076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.886286] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.886371] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.886534] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.886631] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.886691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.886857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.886913] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.887188] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.887188] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.887281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.887420] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.887467] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.887548] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 488a6d2c-cf42-40ee-ab99-ba41d4e437df is going to be updated. [ 829.888638] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33070768-249a-4c90-b087-54185820f170',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.911271] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.911480] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.911527] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.911765] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.911890] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.912066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.912536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.912731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.912907] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.913074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.913146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.913330] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.913445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.913553] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d884cf8-f142-472b-a29a-26176fe2cf88',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.915307] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.915458] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.915526] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.915704] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.915840] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.915998] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-488a6d2c-cf42-40ee-ab99-ba41d4e437df" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.330140] env[66994]: INFO networking_nsxv3.common.synchronization [req-5bb98c6e-3632-4eee-9275-40f29dd2bef6 req-9723a0ee-d23d-4acf-a876-651a90444260 tempest-AttachVolumeShelveTestJSON-810060241 tempest-AttachVolumeShelveTestJSON-810060241-project-member] Enqueued Resource ID: 0023a3cd-aa32-4af2-a423-608695d50731 with Priority: HIGHEST for action security_group_members [ 830.330731] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0023a3cd-aa32-4af2-a423-608695d50731 with Priority: HIGHEST for action security_group_members [ 830.331057] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-0023a3cd-aa32-4af2-a423-608695d50731 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.331256] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.331256] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.331803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.332149] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.332291] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.332379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.332704] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.332850] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.333015] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0023a3cd-aa32-4af2-a423-608695d50731',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.391369] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33070768-249a-4c90-b087-54185820f170',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.417652] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.417849] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.417967] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.418189] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.418408] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.418668] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.418791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.419452] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.419452] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.420189] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.420375] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d884cf8-f142-472b-a29a-26176fe2cf88 already deleted. [ 830.420720] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d884cf8-f142-472b-a29a-26176fe2cf88" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.498370] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: SUCCESS [ 830.498589] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.498762] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.499014] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.499211] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.499327] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.499391] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.500071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.500071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.500071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.500071] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.501493] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.501661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.501861] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.502071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.502454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.502454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.502454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.502568] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.771019] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.771019] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-988" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.771019] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-988" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.771019] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-988" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.771019] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.771019] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.771019] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.771759] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.776520] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.776520] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 830.776520] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 830.776520] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 830.776520] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 830.776520] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 830.776520] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 830.776520] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 830.798280] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 830.798379] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 830.800796] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 830.800796] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-988" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.800796] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-bd7439df-d1c9-48bc-a885-d3243d84d319 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.800796] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-bd7439df-d1c9-48bc-a885-d3243d84d319" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.800796] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-bd7439df-d1c9-48bc-a885-d3243d84d319" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.800796] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-bd7439df-d1c9-48bc-a885-d3243d84d319" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.800796] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd7439df-d1c9-48bc-a885-d3243d84d319',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.840244] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.840419] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.840488] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.840733] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.842210] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.842742] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.842874] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.842937] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.843177] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.843303] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.843641] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0023a3cd-aa32-4af2-a423-608695d50731 already deleted. [ 830.843641] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.895660] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.895830] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.895926] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.896194] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.896313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.896422] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33070768-249a-4c90-b087-54185820f170 is going to be created. [ 830.924392] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.924623] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.924709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.924931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.925112] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.940940] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33070768-249a-4c90-b087-54185820f170 in Status: UNINITIALIZED for 2s [ 831.005436] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.005436] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.005436] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.305091] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.305091] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.305091] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.305091] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.305091] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.305091] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port bd7439df-d1c9-48bc-a885-d3243d84d319 not found, creating... [ 831.305091] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.305091] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.305091] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.305091] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.305091] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.305697] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.306296] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.306625] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.308691] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.308691] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.308691] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: bd7439df-d1c9-48bc-a885-d3243d84d319 is going to be created. [ 831.332227] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.332227] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.332227] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.332227] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.332227] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.332227] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-bd7439df-d1c9-48bc-a885-d3243d84d319" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.509534] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.011541] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.011748] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.011785] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.011980] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.012084] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.012182] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 is going to be updated. [ 832.050087] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.050087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.050087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.050578] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.050935] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.065832] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: IN_PROGRESS for 2s [ 832.069521] env[66994]: INFO networking_nsxv3.common.synchronization [req-5bb98c6e-3632-4eee-9275-40f29dd2bef6 req-f893b5c7-f1eb-4ab8-8343-68d08f338117 service nova] Enqueued Resource ID: 0023a3cd-aa32-4af2-a423-608695d50731 with Priority: HIGHEST for action security_group_rules [ 832.069698] env[66994]: INFO networking_nsxv3.common.synchronization [req-5bb98c6e-3632-4eee-9275-40f29dd2bef6 req-f893b5c7-f1eb-4ab8-8343-68d08f338117 service nova] Enqueued Resource ID: 0023a3cd-aa32-4af2-a423-608695d50731 with Priority: HIGHEST for action security_group_members [ 832.069872] env[66994]: INFO networking_nsxv3.common.synchronization [req-5bb98c6e-3632-4eee-9275-40f29dd2bef6 req-f893b5c7-f1eb-4ab8-8343-68d08f338117 service nova] Enqueued Resource ID: bd7439df-d1c9-48bc-a885-d3243d84d319 with Priority: HIGHEST for action port [ 832.070611] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0023a3cd-aa32-4af2-a423-608695d50731 with Priority: HIGHEST for action security_group_rules [ 832.070611] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0023a3cd-aa32-4af2-a423-608695d50731 with Priority: HIGHEST for action security_group_members [ 832.070611] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd7439df-d1c9-48bc-a885-d3243d84d319 with Priority: HIGHEST for action port [ 832.071146] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0023a3cd-aa32-4af2-a423-608695d50731 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.071146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.071146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.071435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.071435] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0023a3cd-aa32-4af2-a423-608695d50731',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.073223] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-0023a3cd-aa32-4af2-a423-608695d50731 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.073350] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.073422] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.073610] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.073761] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.073968] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.074048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.074335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.074424] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.074578] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0023a3cd-aa32-4af2-a423-608695d50731',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.075410] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd7439df-d1c9-48bc-a885-d3243d84d319 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.075525] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd7439df-d1c9-48bc-a885-d3243d84d319" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.075582] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd7439df-d1c9-48bc-a885-d3243d84d319" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.075761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd7439df-d1c9-48bc-a885-d3243d84d319" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.075890] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd7439df-d1c9-48bc-a885-d3243d84d319',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.579289] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd7439df-d1c9-48bc-a885-d3243d84d319 with status ACTIVE [ 832.579658] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.579658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.579778] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.580123] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.580278] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.580595] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.580685] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.580751] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.581183] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.581344] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.581656] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.582101] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.582101] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.582246] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.582246] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.582329] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd7439df-d1c9-48bc-a885-d3243d84d319 is going to be updated. [ 832.584477] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-0023a3cd-aa32-4af2-a423-608695d50731 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.584627] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.584849] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0023a3cd-aa32-4af2-a423-608695d50731',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.620031] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.620210] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.620351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.620613] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.620795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.621155] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd7439df-d1c9-48bc-a885-d3243d84d319" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.955183] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33070768-249a-4c90-b087-54185820f170 in Status: SUCCESS [ 832.955589] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.955855] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.956201] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.956505] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.957882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.957882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.957882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.957882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.957882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.958109] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33070768-249a-4c90-b087-54185820f170',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.985698] env[66994]: INFO networking_nsxv3.common.synchronization [req-f5fe0aff-0304-482c-9edb-948f2c87895a req-845f6862-9db7-4737-b449-10ba7a587b23 tempest-ServersTestJSON-587851554 tempest-ServersTestJSON-587851554-project-member] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 832.987060] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 832.987060] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.987060] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.987060] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.987345] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.987441] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.987537] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.987596] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.987759] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.987841] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.987937] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.087454] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0023a3cd-aa32-4af2-a423-608695d50731',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.380479] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.380697] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.380820] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.381344] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.382532] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.382532] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.382532] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.382878] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.383128] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.383616] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 833.383616] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 833.383742] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 833.383863] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 833.384060] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 833.384179] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 833.384402] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 833.412184] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 833.412359] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 833.414135] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 833.414135] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.414135] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-8033cac2-7a93-4181-a2f2-1cc477b6e69d taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.414135] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-8033cac2-7a93-4181-a2f2-1cc477b6e69d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.414135] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-8033cac2-7a93-4181-a2f2-1cc477b6e69d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.414135] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-8033cac2-7a93-4181-a2f2-1cc477b6e69d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.414135] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8033cac2-7a93-4181-a2f2-1cc477b6e69d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.460885] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-33070768-249a-4c90-b087-54185820f170 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.461086] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.461197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.461398] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.461600] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.461664] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.461719] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.461876] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.461977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.462153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.462734] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-33070768-249a-4c90-b087-54185820f170 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.462734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.462734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.462734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.462950] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.462950] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.462950] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.463073] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.463152] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.463184] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.463272] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33070768-249a-4c90-b087-54185820f170',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.493530] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.591855] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.592226] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.592226] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.594063] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.594063] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.594063] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0023a3cd-aa32-4af2-a423-608695d50731 is going to be created. [ 833.630292] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.630522] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.630522] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.630783] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.630965] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.645811] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0023a3cd-aa32-4af2-a423-608695d50731 in Status: UNINITIALIZED for 2s [ 833.918266] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.918570] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.918750] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.919117] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.919320] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.919522] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 8033cac2-7a93-4181-a2f2-1cc477b6e69d not found, creating... [ 833.919868] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.920164] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.920323] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.920595] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.920784] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.921194] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.921384] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.921504] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.921733] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.921917] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.922127] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 8033cac2-7a93-4181-a2f2-1cc477b6e69d is going to be created. [ 833.951086] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.951313] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.951432] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.951839] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.952094] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.952414] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-8033cac2-7a93-4181-a2f2-1cc477b6e69d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.965655] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33070768-249a-4c90-b087-54185820f170: rpc.has_security_group_logging(os_id): False [ 833.986569] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.986978] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.986978] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.987104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.987221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.987464] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.987574] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.987639] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.987834] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.987927] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.988250] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.988371] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.988444] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.988609] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.988720] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.988933] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.989078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.989144] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.989260] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.989344] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.989434] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33070768-249a-4c90-b087-54185820f170 is going to be created. [ 833.996490] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.083432] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.083656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.083726] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.084520] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.084520] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.087476] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: SUCCESS [ 834.087680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.088600] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.088600] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.088913] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.089153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.089317] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.089625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.089787] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.089961] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.090263] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.090453] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.090685] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.090917] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.091014] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.091116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.091203] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.091469] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.091579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.091714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.091798] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.102289] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33070768-249a-4c90-b087-54185820f170 in Status: IN_PROGRESS for 2s [ 834.499945] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.500363] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.500566] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.500907] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.501095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.501264] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 834.538106] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.538106] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.538301] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.538432] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.538535] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.550869] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 834.598421] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9108b2cc-cd11-4784-9282-52da311e05f1: rpc.has_security_group_logging(os_id): False [ 834.621896] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.622079] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.622174] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.622613] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.622771] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.623035] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.623150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.623219] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.623431] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.623620] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.623915] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.624060] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.624134] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.624371] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.624493] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.624819] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.624946] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.625116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.625300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.625418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.625523] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 is going to be created. [ 834.705643] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.705874] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.705996] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.706347] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.706631] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.726225] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: IN_PROGRESS for 2s [ 834.735400] env[66994]: INFO networking_nsxv3.common.synchronization [req-f5fe0aff-0304-482c-9edb-948f2c87895a req-0eda59b0-1a6a-46f9-9ade-edd584580f95 service nova] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_rules [ 834.735400] env[66994]: INFO networking_nsxv3.common.synchronization [req-f5fe0aff-0304-482c-9edb-948f2c87895a req-0eda59b0-1a6a-46f9-9ade-edd584580f95 service nova] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 834.735400] env[66994]: INFO networking_nsxv3.common.synchronization [req-f5fe0aff-0304-482c-9edb-948f2c87895a req-0eda59b0-1a6a-46f9-9ade-edd584580f95 service nova] Enqueued Resource ID: 8033cac2-7a93-4181-a2f2-1cc477b6e69d with Priority: HIGHEST for action port [ 834.735897] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_rules [ 834.736099] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 834.736266] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8033cac2-7a93-4181-a2f2-1cc477b6e69d with Priority: HIGHEST for action port [ 834.736489] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.736607] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.736664] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.737052] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.737192] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.738235] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.738351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.738608] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-8033cac2-7a93-4181-a2f2-1cc477b6e69d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.739817] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8033cac2-7a93-4181-a2f2-1cc477b6e69d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.739817] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8033cac2-7a93-4181-a2f2-1cc477b6e69d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.739817] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8033cac2-7a93-4181-a2f2-1cc477b6e69d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.739817] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8033cac2-7a93-4181-a2f2-1cc477b6e69d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.241700] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.241841] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.242084] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8033cac2-7a93-4181-a2f2-1cc477b6e69d with status ACTIVE [ 835.242266] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.242376] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.242452] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.242705] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.242757] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.242922] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.242975] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.243061] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.243267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.243318] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.243549] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.243657] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.243738] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.243887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.243981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.244106] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8033cac2-7a93-4181-a2f2-1cc477b6e69d is going to be updated. [ 835.273315] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.273553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.273665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.273950] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.274223] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.274485] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8033cac2-7a93-4181-a2f2-1cc477b6e69d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.655891] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0023a3cd-aa32-4af2-a423-608695d50731 in Status: SUCCESS [ 835.656272] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.656323] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.656513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.656701] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.656819] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.656886] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.657053] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.657135] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.657220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.657313] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0023a3cd-aa32-4af2-a423-608695d50731',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.117725] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33070768-249a-4c90-b087-54185820f170 in Status: SUCCESS [ 836.117964] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.159656] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0023a3cd-aa32-4af2-a423-608695d50731',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.561974] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 836.562159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.562338] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.562735] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.562943] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.563121] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.563196] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.563466] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.563466] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.563571] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.661726] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0023a3cd-aa32-4af2-a423-608695d50731: rpc.has_security_group_logging(os_id): False [ 836.680474] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.680664] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.680745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.680962] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.681080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.681336] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.681448] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.681509] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.681697] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.681794] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.681874] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0023a3cd-aa32-4af2-a423-608695d50731 is going to be created. [ 836.743763] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: SUCCESS [ 836.744090] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.744308] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.744639] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.744733] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.747022] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.747681] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.747790] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.748183] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.748289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.762835] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0023a3cd-aa32-4af2-a423-608695d50731 in Status: IN_PROGRESS for 2s [ 836.770434] env[66994]: INFO networking_nsxv3.common.synchronization [req-ca90345b-215f-420d-99c6-4c261274eefc req-10b8d10b-fef5-4012-9ec1-194b3d8bdc47 tempest-ListServerFiltersTestJSON-483871491 tempest-ListServerFiltersTestJSON-483871491-project-member] Enqueued Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_members [ 836.772271] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_members [ 836.773141] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.773141] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.773307] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.773626] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.773834] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.773988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.774123] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.774362] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.774699] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.774853] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.867126] env[66994]: INFO networking_nsxv3.common.synchronization [None req-8fa083a3-b3fd-4a1c-86c4-d2d1ba9ab35a tempest-MigrationsAdminTest-2127426748 tempest-MigrationsAdminTest-2127426748-project-member] Enqueued Resource ID: 7cda0e54-d25f-4553-b875-5f276eed8de4 with Priority: HIGHEST for action security_group_rules [ 836.867126] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cda0e54-d25f-4553-b875-5f276eed8de4 with Priority: HIGHEST for action security_group_rules [ 836.867521] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cda0e54-d25f-4553-b875-5f276eed8de4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.867947] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cda0e54-d25f-4553-b875-5f276eed8de4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.868154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cda0e54-d25f-4553-b875-5f276eed8de4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.870265] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cda0e54-d25f-4553-b875-5f276eed8de4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.870265] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cda0e54-d25f-4553-b875-5f276eed8de4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.972016] env[66994]: INFO networking_nsxv3.common.synchronization [None req-8f14f0c5-f4fe-4c50-aa7f-03a60fcdf4d5 tempest-MigrationsAdminTest-2127426748 tempest-MigrationsAdminTest-2127426748-project-member] Enqueued Resource ID: 7cda0e54-d25f-4553-b875-5f276eed8de4 with Priority: HIGHEST for action security_group_rules [ 836.972643] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cda0e54-d25f-4553-b875-5f276eed8de4 with Priority: HIGHEST for action security_group_rules [ 836.973041] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cda0e54-d25f-4553-b875-5f276eed8de4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.975721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cda0e54-d25f-4553-b875-5f276eed8de4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.066193] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.250719] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.250925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.251088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.251252] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.251527] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.251527] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.251862] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.251862] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.251862] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.252466] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.252466] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.276923] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.397406] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.397672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.397772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.397923] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.398029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.398148] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cda0e54-d25f-4553-b875-5f276eed8de4 already deleted. [ 837.398215] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cda0e54-d25f-4553-b875-5f276eed8de4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.398375] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cda0e54-d25f-4553-b875-5f276eed8de4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.398537] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cda0e54-d25f-4553-b875-5f276eed8de4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.398620] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cda0e54-d25f-4553-b875-5f276eed8de4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.569432] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.755036] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.755036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.755036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.755036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.755472] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.755472] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.755472] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.755472] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.755728] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.755728] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.755814] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.755880] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.755969] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.756103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.756242] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.756334] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.756393] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.756529] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.756605] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.756685] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.756772] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.779602] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.925136] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.925346] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.925346] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.925554] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.925641] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.925736] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cda0e54-d25f-4553-b875-5f276eed8de4 already deleted. [ 837.925815] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cda0e54-d25f-4553-b875-5f276eed8de4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.073245] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.073245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.073245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.073245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.073245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.073245] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 838.149015] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.149215] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.149263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.149500] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.149656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.180295] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 838.262214] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9108b2cc-cd11-4784-9282-52da311e05f1: rpc.has_security_group_logging(os_id): False [ 838.282133] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.282304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.282365] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.283284] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.283470] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.283587] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb is going to be updated. [ 838.319959] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.320167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.320212] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.320784] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.320784] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.320784] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.320784] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.321583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.321583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.321583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.321583] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.321583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.321583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.321583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.321931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.321931] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.321931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.321931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.322662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.322772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.322863] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 is going to be updated. [ 838.351994] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.352208] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.352262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.352462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.352629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.361592] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: IN_PROGRESS for 2s [ 838.391711] env[66994]: INFO networking_nsxv3.common.synchronization [req-bed6fbf8-297c-4d84-9bfb-55bdbdedddda req-06d5b9b7-d2f4-49f4-8060-01a1779b58d8 tempest-AttachInterfacesV270Test-1270757815 tempest-AttachInterfacesV270Test-1270757815-project-member] Enqueued Resource ID: 9cde16ce-be95-4b19-a4ea-e24f03fb1476 with Priority: HIGHEST for action security_group_members [ 838.392395] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cde16ce-be95-4b19-a4ea-e24f03fb1476 with Priority: HIGHEST for action security_group_members [ 838.392757] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cde16ce-be95-4b19-a4ea-e24f03fb1476 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.392895] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.392977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.393606] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.393606] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.393606] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.393801] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.393870] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.393956] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.394083] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cde16ce-be95-4b19-a4ea-e24f03fb1476',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.407338] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.407497] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.407542] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.407755] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.407902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.434584] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: IN_PROGRESS for 2s [ 838.781631] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0023a3cd-aa32-4af2-a423-608695d50731 in Status: SUCCESS [ 838.782080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.895929] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-908 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.896261] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-908" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.896458] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-908" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.897064] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-908" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.897399] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.897606] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.898150] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.898150] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.898380] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.898469] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 838.898574] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 838.898739] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 838.898841] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 838.898945] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 838.899049] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 838.899196] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 838.901146] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.901324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.901324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.901548] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.901636] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.901845] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.901927] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.902040] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.902339] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.902339] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.902489] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cde16ce-be95-4b19-a4ea-e24f03fb1476 already deleted. [ 838.902644] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.923782] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 838.924041] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 838.924191] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 838.924297] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-908" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.924699] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-07a5cd29-19b3-49de-91b8-4f2285ba96ba taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.924917] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-07a5cd29-19b3-49de-91b8-4f2285ba96ba" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.925061] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-07a5cd29-19b3-49de-91b8-4f2285ba96ba" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.925668] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-07a5cd29-19b3-49de-91b8-4f2285ba96ba" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.925861] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07a5cd29-19b3-49de-91b8-4f2285ba96ba',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.429248] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.429248] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.429742] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.429742] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.429999] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.430214] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 07a5cd29-19b3-49de-91b8-4f2285ba96ba not found, creating... [ 839.430513] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.430689] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.430805] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.431069] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.431219] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.431520] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.431770] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.431840] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.431998] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.432141] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.432280] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 07a5cd29-19b3-49de-91b8-4f2285ba96ba is going to be created. [ 839.457362] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.457720] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.457883] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.458184] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.458601] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.458901] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-07a5cd29-19b3-49de-91b8-4f2285ba96ba" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.192930] env[66994]: INFO networking_nsxv3.common.synchronization [req-bed6fbf8-297c-4d84-9bfb-55bdbdedddda req-b63bd476-6099-4ba6-a1fd-2f7696f2c79f service nova] Enqueued Resource ID: 9cde16ce-be95-4b19-a4ea-e24f03fb1476 with Priority: HIGHEST for action security_group_rules [ 840.192930] env[66994]: INFO networking_nsxv3.common.synchronization [req-bed6fbf8-297c-4d84-9bfb-55bdbdedddda req-b63bd476-6099-4ba6-a1fd-2f7696f2c79f service nova] Enqueued Resource ID: 9cde16ce-be95-4b19-a4ea-e24f03fb1476 with Priority: HIGHEST for action security_group_members [ 840.193440] env[66994]: INFO networking_nsxv3.common.synchronization [req-bed6fbf8-297c-4d84-9bfb-55bdbdedddda req-b63bd476-6099-4ba6-a1fd-2f7696f2c79f service nova] Enqueued Resource ID: 07a5cd29-19b3-49de-91b8-4f2285ba96ba with Priority: HIGHEST for action port [ 840.195139] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 840.195139] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.196223] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cde16ce-be95-4b19-a4ea-e24f03fb1476 with Priority: HIGHEST for action security_group_rules [ 840.196381] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cde16ce-be95-4b19-a4ea-e24f03fb1476 with Priority: HIGHEST for action security_group_members [ 840.196491] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07a5cd29-19b3-49de-91b8-4f2285ba96ba with Priority: HIGHEST for action port [ 840.196900] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.197066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.197289] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.197486] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.197529] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.197931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.198116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.198156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.198276] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.202231] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cde16ce-be95-4b19-a4ea-e24f03fb1476 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.202231] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.202231] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.202231] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.202231] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cde16ce-be95-4b19-a4ea-e24f03fb1476',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.202911] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cde16ce-be95-4b19-a4ea-e24f03fb1476 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.202911] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.202911] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.202911] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.203139] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.203139] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.203139] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.203297] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.203584] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.203818] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cde16ce-be95-4b19-a4ea-e24f03fb1476',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.205486] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-07a5cd29-19b3-49de-91b8-4f2285ba96ba taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.205672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07a5cd29-19b3-49de-91b8-4f2285ba96ba" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.205672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07a5cd29-19b3-49de-91b8-4f2285ba96ba" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.205886] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07a5cd29-19b3-49de-91b8-4f2285ba96ba" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.206022] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07a5cd29-19b3-49de-91b8-4f2285ba96ba',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.389196] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: SUCCESS [ 840.389322] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.458679] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: SUCCESS [ 840.458679] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.710224] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9cde16ce-be95-4b19-a4ea-e24f03fb1476',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.711422] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cde16ce-be95-4b19-a4ea-e24f03fb1476 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.711686] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.712025] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07a5cd29-19b3-49de-91b8-4f2285ba96ba with status ACTIVE [ 840.712025] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.712212] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.712212] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.712413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.712517] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.712731] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.712880] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.712942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.713108] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.713185] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.713670] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.713670] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.713670] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.713980] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.713980] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.713980] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07a5cd29-19b3-49de-91b8-4f2285ba96ba is going to be updated. [ 840.716824] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.716824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.716824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.716824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.716824] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.716824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.716824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.716824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.716824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.716824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.716824] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.716824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.716824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.716824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.718356] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.718356] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.718356] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.718356] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.718356] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.718356] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.718356] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.749946] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.750227] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.750227] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.750520] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.750777] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.753412] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07a5cd29-19b3-49de-91b8-4f2285ba96ba" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.873626] env[66994]: INFO networking_nsxv3.common.synchronization [req-4da7d299-51a6-424f-af0e-7256074c6633 req-77f9ce0c-34fc-43b2-a510-78390bd7cf8f tempest-ServersV294TestFqdnHostnames-1429624545 tempest-ServersV294TestFqdnHostnames-1429624545-project-member] Enqueued Resource ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 with Priority: HIGHEST for action security_group_members [ 840.874227] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 with Priority: HIGHEST for action security_group_members [ 840.874851] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-52c814d2-8c46-4f11-a3ab-47d2b96480f7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.874851] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.874851] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.875100] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.876849] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.877016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.877108] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.877397] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.878106] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.878253] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52c814d2-8c46-4f11-a3ab-47d2b96480f7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.221233] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9cde16ce-be95-4b19-a4ea-e24f03fb1476',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.223781] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8: rpc.has_security_group_logging(os_id): False [ 841.244208] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.244208] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.244440] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.244440] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.367314] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.367454] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.367691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.367691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.367815] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.367900] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.368104] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.368195] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.368253] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.368406] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.368474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.368652] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.368769] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.368810] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.368998] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.369378] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.369586] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 841.382125] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.382125] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.382125] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.382125] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.413955] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.414765] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.414894] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.415690] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.415972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.416442] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.416442] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 is going to be updated. [ 841.442756] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.442756] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.442877] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.443043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.443254] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.453261] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 in Status: IN_PROGRESS for 2s [ 841.456338] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.457455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.457556] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.457761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.457915] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.476478] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 841.725134] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.725399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.725399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.726063] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.726063] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.726063] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cde16ce-be95-4b19-a4ea-e24f03fb1476 is going to be created. [ 841.752247] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.752247] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.752247] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.752247] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.752508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.763697] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cde16ce-be95-4b19-a4ea-e24f03fb1476 in Status: UNINITIALIZED for 2s [ 843.467359] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 in Status: SUCCESS [ 843.467733] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 deletion is rescheduled due to dependency. [ 843.467733] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.496415] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 843.496415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.776935] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cde16ce-be95-4b19-a4ea-e24f03fb1476 in Status: SUCCESS [ 843.777348] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.777566] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.777767] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.777924] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.778134] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.778134] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.778218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.778333] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.778454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.778568] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9cde16ce-be95-4b19-a4ea-e24f03fb1476',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.282947] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cde16ce-be95-4b19-a4ea-e24f03fb1476 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.283239] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.283489] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.283690] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.283960] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.284601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.284731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.284920] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.285026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.285121] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.285286] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cde16ce-be95-4b19-a4ea-e24f03fb1476 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.285477] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.285552] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.285706] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.285851] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.285944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.286009] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.286156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.286231] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.286312] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.286400] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9cde16ce-be95-4b19-a4ea-e24f03fb1476',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.788741] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9cde16ce-be95-4b19-a4ea-e24f03fb1476: rpc.has_security_group_logging(os_id): False [ 844.807770] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.807921] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.807992] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.808215] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.810087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.810087] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.810087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.810087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.810087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.810087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.810087] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.810087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.810087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.810087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.810087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.810087] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.810087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.810087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.810621] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.810621] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.810621] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cde16ce-be95-4b19-a4ea-e24f03fb1476 is going to be created. [ 844.819548] env[66994]: INFO networking_nsxv3.common.synchronization [req-cedbf075-b849-4535-b05f-18f37a83d19c req-b55a752f-50b0-42ee-82a7-ccdb44b4886c tempest-ServersTestMultiNic-1223700725 tempest-ServersTestMultiNic-1223700725-project-member] Enqueued Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 844.820101] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 844.820632] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.820839] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.820887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.821102] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.821285] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.821403] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.821445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.821594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.821676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.821793] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.877559] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.877757] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.877838] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.878101] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.878507] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.891180] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cde16ce-be95-4b19-a4ea-e24f03fb1476 in Status: IN_PROGRESS for 2s [ 845.009203] env[66994]: INFO networking_nsxv3.common.synchronization [req-cedbf075-b849-4535-b05f-18f37a83d19c req-d62ee5f1-c558-41ce-b256-41fce3869d7a tempest-ServersTestMultiNic-1223700725 tempest-ServersTestMultiNic-1223700725-project-member] Enqueued Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 845.009789] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGHEST for action security_group_members [ 845.010149] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.010252] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.326502] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.829160] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.335367] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.335510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.336236] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.336236] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.336236] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.336236] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 is going to be updated. [ 846.365041] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.365233] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.365233] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.365450] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.365590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.377206] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: IN_PROGRESS for 2s [ 846.907038] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cde16ce-be95-4b19-a4ea-e24f03fb1476 in Status: SUCCESS [ 846.907470] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.195956] env[66994]: INFO networking_nsxv3.common.synchronization [req-025bcc72-855c-4291-bf4e-ce9c38b6b119 req-4418dc27-0753-4c02-8286-a6b528d113c1 tempest-ServersTestJSON-587851554 tempest-ServersTestJSON-587851554-project-member] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 847.200042] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 847.200042] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.200042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.200042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.200042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.200042] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.200042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.200042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.200042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.200042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.200042] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.706303] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.796160] env[66994]: INFO networking_nsxv3.common.synchronization [req-5a4e3612-1b75-4cbd-9c16-be491e4d778c req-bd37f830-a2c6-4123-b391-971fb46c7962 tempest-ServerTagsTestJSON-338534640 tempest-ServerTagsTestJSON-338534640-project-member] Enqueued Resource ID: 33070768-249a-4c90-b087-54185820f170 with Priority: HIGHEST for action security_group_members [ 847.797076] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33070768-249a-4c90-b087-54185820f170 with Priority: HIGHEST for action security_group_members [ 847.797551] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-33070768-249a-4c90-b087-54185820f170 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.797753] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.797836] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.798131] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.798336] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.798514] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.798514] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.799311] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.799311] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.799311] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33070768-249a-4c90-b087-54185820f170',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.918193] env[66994]: INFO networking_nsxv3.common.synchronization [req-8855618d-0763-4a78-8a2c-64d0420361e7 req-65c9a7aa-365e-46f7-9620-983a0d0cbccb tempest-ServersAdminTestJSON-1722983547 tempest-ServersAdminTestJSON-1722983547-project-member] Enqueued Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 847.918762] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 847.919083] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.919223] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.919273] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.919463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.919617] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.919719] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.919790] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.919931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.920025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.920118] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.164156] env[66994]: INFO networking_nsxv3.common.synchronization [req-d46718ee-3498-493c-b9d8-4688754a9057 req-a1f42006-a498-4344-9638-2900373d4e7f tempest-ListImageFiltersTestJSON-572163632 tempest-ListImageFiltersTestJSON-572163632-project-member] Enqueued Resource ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e with Priority: HIGHEST for action security_group_members [ 848.165534] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e with Priority: HIGHEST for action security_group_members [ 848.165534] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.165534] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.165534] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.165825] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.165966] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.166100] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.166187] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.166368] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.166456] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.166551] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aaddbb4b-3076-42ef-afd8-2dcbedf8773e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.212261] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.307945] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.307945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.307945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.307945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.307945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.307945] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.307945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.307945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.307945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.307945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.307945] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33070768-249a-4c90-b087-54185820f170 is going to be updated. [ 848.377822] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.378037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.378131] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.378384] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.378601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.398322] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33070768-249a-4c90-b087-54185820f170 in Status: IN_PROGRESS for 2s [ 848.398712] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: SUCCESS [ 848.399015] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.399216] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.399931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.400115] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.400310] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.400409] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.400587] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.400670] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.400770] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.422635] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.668995] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.669172] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.669274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.669459] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.693563] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.693824] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.693944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.694027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.694224] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.694304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.694395] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e is going to be updated. [ 848.713347] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.713347] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.713533] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.713619] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.713707] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.713810] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 848.724722] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.724888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.724961] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.725196] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.725359] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.736235] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e in Status: IN_PROGRESS for 2s [ 848.748416] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.748705] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.749060] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.749335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.749496] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.763437] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 848.905432] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.905432] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.905432] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.905432] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.905432] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.905432] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.905432] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.905432] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.905432] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.905432] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.905432] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 is going to be updated. [ 848.924791] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.937129] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.937129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.937129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.937129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.937129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.948910] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: IN_PROGRESS for 2s [ 849.427823] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.427980] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.428104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.428462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.428651] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.428732] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 is going to be updated. [ 849.467321] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.467509] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.467581] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.467828] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.467984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.479410] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: IN_PROGRESS for 2s [ 849.680084] env[66994]: INFO networking_nsxv3.common.synchronization [req-4d017c6e-b474-4a13-bc5a-6f14a7c17fe7 req-5bcc15a0-502b-4170-ae83-2e9ff1615a76 tempest-ServerDiskConfigTestJSON-2121377508 tempest-ServerDiskConfigTestJSON-2121377508-project-member] Enqueued Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 849.680672] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 849.680992] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.681135] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.681203] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.681406] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.681582] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.681709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.681709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.681860] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.682118] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.682118] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.017052] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-172 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.017426] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-172" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.017426] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-172" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.017687] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-172" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.017974] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.018475] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.018629] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.018883] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.019144] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.019345] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.019486] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 850.019617] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 850.019748] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 850.019884] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.020018] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 850.020187] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 850.044901] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 850.045188] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 850.045267] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 850.045448] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-172" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.045862] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-dde701a4-cbce-4665-aab2-e56d35aa820a taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.046065] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-dde701a4-cbce-4665-aab2-e56d35aa820a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.046186] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-dde701a4-cbce-4665-aab2-e56d35aa820a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.046566] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-dde701a4-cbce-4665-aab2-e56d35aa820a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.046705] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dde701a4-cbce-4665-aab2-e56d35aa820a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.184513] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.184757] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.184857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.185062] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.185153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.185366] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.185460] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.185531] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.185684] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.185755] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.185902] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 is going to be updated. [ 850.224560] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.224750] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.224795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.225061] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.225222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.240590] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: IN_PROGRESS for 2s [ 850.413301] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33070768-249a-4c90-b087-54185820f170 in Status: SUCCESS [ 850.413534] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33070768-249a-4c90-b087-54185820f170 deletion is rescheduled due to dependency. [ 850.413637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.550027] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.550901] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.550901] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.550901] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.551036] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.551179] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port dde701a4-cbce-4665-aab2-e56d35aa820a not found, creating... [ 850.551443] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.551618] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.551783] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.552140] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.552197] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.553566] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.553566] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.553566] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.553566] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.553566] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.553566] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: dde701a4-cbce-4665-aab2-e56d35aa820a is going to be created. [ 850.577801] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.578661] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.578661] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.578661] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.578821] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.579163] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-dde701a4-cbce-4665-aab2-e56d35aa820a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.746487] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e in Status: SUCCESS [ 850.746720] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e deletion is rescheduled due to dependency. [ 850.747273] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.774553] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 850.774802] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.958238] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9108b2cc-cd11-4784-9282-52da311e05f1 in Status: SUCCESS [ 850.958422] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 deletion is rescheduled due to dependency. [ 850.958561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.267687] env[66994]: INFO networking_nsxv3.common.synchronization [req-4d017c6e-b474-4a13-bc5a-6f14a7c17fe7 req-d1cbb73a-7739-4f73-a6cd-20e64d64dddc service nova] Enqueued Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_rules [ 851.267987] env[66994]: INFO networking_nsxv3.common.synchronization [req-4d017c6e-b474-4a13-bc5a-6f14a7c17fe7 req-d1cbb73a-7739-4f73-a6cd-20e64d64dddc service nova] Enqueued Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 851.267987] env[66994]: INFO networking_nsxv3.common.synchronization [req-4d017c6e-b474-4a13-bc5a-6f14a7c17fe7 req-d1cbb73a-7739-4f73-a6cd-20e64d64dddc service nova] Enqueued Resource ID: dde701a4-cbce-4665-aab2-e56d35aa820a with Priority: HIGHEST for action port [ 851.268540] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_rules [ 851.268685] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 851.268783] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dde701a4-cbce-4665-aab2-e56d35aa820a with Priority: HIGHEST for action port [ 851.269422] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.269649] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.269649] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.269843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.269934] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.272173] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.272173] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.272173] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-dde701a4-cbce-4665-aab2-e56d35aa820a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.272399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dde701a4-cbce-4665-aab2-e56d35aa820a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.272399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dde701a4-cbce-4665-aab2-e56d35aa820a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.272541] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dde701a4-cbce-4665-aab2-e56d35aa820a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.273419] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dde701a4-cbce-4665-aab2-e56d35aa820a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.492031] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: SUCCESS [ 851.492031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.772614] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.772614] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.775527] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dde701a4-cbce-4665-aab2-e56d35aa820a with status ACTIVE [ 851.775746] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.778218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.778218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.778218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.778218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.778218] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.778218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.778218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.778218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.778218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.778218] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.778218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.778218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.778877] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.778877] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.778877] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dde701a4-cbce-4665-aab2-e56d35aa820a is going to be updated. [ 851.803952] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.804549] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.804549] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.804549] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.804549] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.804732] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dde701a4-cbce-4665-aab2-e56d35aa820a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.253679] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: SUCCESS [ 852.253679] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 deletion is rescheduled due to dependency. [ 852.253679] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.253679] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.254179] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.254179] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.254321] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.254321] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.254593] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.254593] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.254593] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.358226] env[66994]: INFO networking_nsxv3.common.synchronization [req-04e38649-a246-4fe1-9575-7c6b0340cc38 req-0c436e8b-cefb-4478-b14a-ff0c9bd903c0 tempest-ImagesOneServerNegativeTestJSON-1432587522 tempest-ImagesOneServerNegativeTestJSON-1432587522-project-member] Enqueued Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_members [ 852.358226] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_members [ 852.359328] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-11c0b684-9731-4046-89ad-f4bf7b2168d4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.359864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.360404] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.360758] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.364287] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.364287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.364287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.364287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.364287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.364287] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.757612] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.842746] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-767 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.842974] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-767" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.843110] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-767" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.843525] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-767" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.843770] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.843934] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.844141] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.844416] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.844600] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.845516] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 852.845731] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 852.845874] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 852.846032] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 852.846177] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 852.846354] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 852.846524] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 852.867438] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 852.867623] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 852.867781] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 852.867942] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-767" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.868277] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-89e76366-6f38-4ff0-927c-a50ee10bd237 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.868449] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-89e76366-6f38-4ff0-927c-a50ee10bd237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.868580] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-89e76366-6f38-4ff0-927c-a50ee10bd237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.868904] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-89e76366-6f38-4ff0-927c-a50ee10bd237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.869063] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89e76366-6f38-4ff0-927c-a50ee10bd237',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.870085] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.870200] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.870262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.870434] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.893749] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.894320] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.894320] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.894320] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.894536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.894536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.894607] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 is going to be updated. [ 852.923302] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.923503] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.923503] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.923717] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.923863] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.933612] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 in Status: IN_PROGRESS for 2s [ 853.259936] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.374112] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.374633] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.374633] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.375036] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.375215] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.375386] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 89e76366-6f38-4ff0-927c-a50ee10bd237 not found, creating... [ 853.375710] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.375932] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.376086] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.376425] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.376540] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.376898] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.377060] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.377242] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.377480] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.377559] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.377699] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 89e76366-6f38-4ff0-927c-a50ee10bd237 is going to be created. [ 853.402448] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.402794] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.402956] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.403272] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.403529] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.403902] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-89e76366-6f38-4ff0-927c-a50ee10bd237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.762861] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.763090] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.763177] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.763410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.763616] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.763675] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 is going to be updated. [ 853.795350] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.795350] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.795350] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.795532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.795570] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.804984] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: IN_PROGRESS for 2s [ 854.148407] env[66994]: INFO networking_nsxv3.common.synchronization [req-04e38649-a246-4fe1-9575-7c6b0340cc38 req-946d9f4f-bfd6-49b9-baf5-e12df9365b66 service nova] Enqueued Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_rules [ 854.148638] env[66994]: INFO networking_nsxv3.common.synchronization [req-04e38649-a246-4fe1-9575-7c6b0340cc38 req-946d9f4f-bfd6-49b9-baf5-e12df9365b66 service nova] Enqueued Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_members [ 854.148802] env[66994]: INFO networking_nsxv3.common.synchronization [req-04e38649-a246-4fe1-9575-7c6b0340cc38 req-946d9f4f-bfd6-49b9-baf5-e12df9365b66 service nova] Enqueued Resource ID: 89e76366-6f38-4ff0-927c-a50ee10bd237 with Priority: HIGHEST for action port [ 854.149403] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_rules [ 854.149583] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_members [ 854.149749] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89e76366-6f38-4ff0-927c-a50ee10bd237 with Priority: HIGHEST for action port [ 854.150100] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11c0b684-9731-4046-89ad-f4bf7b2168d4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.150258] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.150351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.150587] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.150706] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.152057] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-11c0b684-9731-4046-89ad-f4bf7b2168d4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.152221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.152435] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-89e76366-6f38-4ff0-927c-a50ee10bd237 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.152576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89e76366-6f38-4ff0-927c-a50ee10bd237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.152664] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89e76366-6f38-4ff0-927c-a50ee10bd237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.152883] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89e76366-6f38-4ff0-927c-a50ee10bd237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.152995] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89e76366-6f38-4ff0-927c-a50ee10bd237',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.657023] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-11c0b684-9731-4046-89ad-f4bf7b2168d4 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.657023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.657023] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89e76366-6f38-4ff0-927c-a50ee10bd237 with status ACTIVE [ 854.657023] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.657023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.657023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.657023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.657023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.657023] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.657023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.657023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.657023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.657023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.657023] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.657898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.657898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.657898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.657898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.657898] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89e76366-6f38-4ff0-927c-a50ee10bd237 is going to be updated. [ 854.686040] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.686620] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.687891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.687891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.687891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.687891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89e76366-6f38-4ff0-927c-a50ee10bd237" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.947080] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 in Status: SUCCESS [ 854.947283] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 deletion is rescheduled due to dependency. [ 854.947398] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.947566] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.947783] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.947989] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.948123] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.948187] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.948350] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.948432] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.948524] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.454092] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.680882] env[66994]: INFO networking_nsxv3.common.synchronization [None req-b75b23eb-2c50-4ed1-a25d-a5cd7e8c468c None None] Enqueued Resource ID: 23949541-995f-4e87-8ecb-e93777bb5d2c with Priority: HIGHEST for action port [ 855.687025] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23949541-995f-4e87-8ecb-e93777bb5d2c with Priority: HIGHEST for action port [ 855.687025] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-23949541-995f-4e87-8ecb-e93777bb5d2c taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.687025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23949541-995f-4e87-8ecb-e93777bb5d2c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.687025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23949541-995f-4e87-8ecb-e93777bb5d2c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.687025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23949541-995f-4e87-8ecb-e93777bb5d2c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.687025] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23949541-995f-4e87-8ecb-e93777bb5d2c',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.816029] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: SUCCESS [ 855.816029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.816029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.816268] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.816424] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.816544] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.816612] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.816962] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.816962] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.816962] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.817490] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.958615] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.189611] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23949541-995f-4e87-8ecb-e93777bb5d2c [ 856.189883] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.190053] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.190126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.190367] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.190466] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.190565] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23949541-995f-4e87-8ecb-e93777bb5d2c already deleted. [ 856.190645] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23949541-995f-4e87-8ecb-e93777bb5d2c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.308861] env[66994]: INFO networking_nsxv3.common.synchronization [req-98e05c61-db77-4a43-a28d-f799ef35d83f req-4dc0737a-6d5d-4213-92b4-bf599d952f7d tempest-AttachInterfacesV270Test-1270757815 tempest-AttachInterfacesV270Test-1270757815-project-member] Enqueued Resource ID: 9cde16ce-be95-4b19-a4ea-e24f03fb1476 with Priority: HIGHEST for action security_group_members [ 856.309482] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cde16ce-be95-4b19-a4ea-e24f03fb1476 with Priority: HIGHEST for action security_group_members [ 856.309909] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cde16ce-be95-4b19-a4ea-e24f03fb1476 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.311457] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.311602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.311830] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.312016] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.312131] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.312196] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.312351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.312437] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.312533] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cde16ce-be95-4b19-a4ea-e24f03fb1476',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.321267] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.321267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.321267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.321544] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.322747] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.322904] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.323012] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.323386] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.323386] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.323530] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.323628] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.323789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.323862] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.324939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.324939] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.324939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.324939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.324939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.324939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.325462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.325462] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.466526] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.466526] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.466526] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.466526] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.466526] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.466526] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 is going to be updated. [ 856.496125] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.496270] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.496342] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.496551] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.496917] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.510265] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 in Status: IN_PROGRESS for 2s [ 856.817546] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.817546] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.817546] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.819902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.819902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.819902] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.819902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.819902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.819902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.819902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.819902] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cde16ce-be95-4b19-a4ea-e24f03fb1476 is going to be updated. [ 856.830035] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b62a4f35-964f-404b-ba36-70b4e8cb2dc5: rpc.has_security_group_logging(os_id): False [ 856.849485] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.849485] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.849485] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.849485] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.849485] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.849485] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.849485] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.849485] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.849485] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.849485] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.849485] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.849485] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.849485] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.849485] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.849485] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.850563] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.852370] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.852370] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.852370] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.852370] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.852370] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 is going to be updated. [ 856.870088] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.870851] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.870851] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.870851] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.870851] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.880031] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cde16ce-be95-4b19-a4ea-e24f03fb1476 in Status: IN_PROGRESS for 2s [ 856.922272] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.922934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.922934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.922934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.923381] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.940598] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: IN_PROGRESS for 2s [ 858.522564] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 in Status: SUCCESS [ 858.523228] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.523228] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.523449] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.523673] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.523863] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.524615] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.525026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.525248] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.525418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.525634] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.891844] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cde16ce-be95-4b19-a4ea-e24f03fb1476 in Status: SUCCESS [ 858.892087] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cde16ce-be95-4b19-a4ea-e24f03fb1476 deletion is rescheduled due to dependency. [ 858.892217] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.959918] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: SUCCESS [ 858.960168] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.029846] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-11c0b684-9731-4046-89ad-f4bf7b2168d4 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.030014] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.030099] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.030327] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.030505] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.030594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.030669] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.030803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.030943] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.030977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.031824] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-11c0b684-9731-4046-89ad-f4bf7b2168d4 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.031824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.031824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.031824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.031824] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.031824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.031824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.031824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.032115] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.032115] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.032115] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.536260] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11c0b684-9731-4046-89ad-f4bf7b2168d4: rpc.has_security_group_logging(os_id): False [ 859.554172] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.554353] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.554603] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.554656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.554779] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.555082] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.555146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.555206] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.555365] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.555455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.555611] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.555703] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.555792] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.555945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.556316] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.556572] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.556728] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.556833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.557031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.557161] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.557292] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 is going to be updated. [ 859.626594] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.626918] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.627010] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.627277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.627478] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.647914] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 in Status: IN_PROGRESS for 2s [ 860.028841] env[66994]: INFO networking_nsxv3.common.synchronization [req-32d0adb9-a5e4-48d8-b767-eaf37ac1106e req-6974892b-a941-435a-8ed0-11d08d17204c tempest-ImagesTestJSON-691407333 tempest-ImagesTestJSON-691407333-project-member] Enqueued Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 860.029425] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 860.029730] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.029853] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.029934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.030832] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.030832] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.030832] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.030832] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.030832] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.031207] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.031207] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.438703] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-744 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.438951] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-744" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.439121] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-744" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.439451] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-744" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.439743] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.439931] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.440081] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.440377] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.440527] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.440800] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 860.440934] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 860.441079] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 860.441260] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 860.441415] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 860.441550] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 860.441733] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 860.463516] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 860.463682] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 860.463818] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 860.463990] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-744" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.464370] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-85ceac25-fbe3-44bf-8c43-d2a4deb91531 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.464635] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-85ceac25-fbe3-44bf-8c43-d2a4deb91531" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.464821] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-85ceac25-fbe3-44bf-8c43-d2a4deb91531" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.465205] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-85ceac25-fbe3-44bf-8c43-d2a4deb91531" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.465348] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85ceac25-fbe3-44bf-8c43-d2a4deb91531',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.533963] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.539027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.539027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.539027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.539027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.539027] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.539027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.539027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.539027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.539027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.539027] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e is going to be updated. [ 860.579768] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.579768] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.579768] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.579768] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.579768] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.597169] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: IN_PROGRESS for 2s [ 860.967544] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.967800] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.967889] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.968272] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.968437] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.968596] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 85ceac25-fbe3-44bf-8c43-d2a4deb91531 not found, creating... [ 860.968902] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.969034] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.969145] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.969373] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.969507] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.969943] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.969943] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.970137] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.970355] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.970498] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.970638] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 85ceac25-fbe3-44bf-8c43-d2a4deb91531 is going to be created. [ 860.995088] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.995335] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.995429] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.995696] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.996140] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.996285] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-85ceac25-fbe3-44bf-8c43-d2a4deb91531" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.386138] env[66994]: INFO networking_nsxv3.common.synchronization [None req-beb890cc-ba0c-4d18-89ec-344506f5f7f4 None None] Enqueued Resource ID: 30ad8345-1835-48d1-b9bf-1e6714d386f1 with Priority: HIGHEST for action port [ 861.387371] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ad8345-1835-48d1-b9bf-1e6714d386f1 with Priority: HIGHEST for action port [ 861.387764] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-30ad8345-1835-48d1-b9bf-1e6714d386f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.388240] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30ad8345-1835-48d1-b9bf-1e6714d386f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.388421] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30ad8345-1835-48d1-b9bf-1e6714d386f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.390018] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30ad8345-1835-48d1-b9bf-1e6714d386f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.390018] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30ad8345-1835-48d1-b9bf-1e6714d386f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.663578] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 in Status: SUCCESS [ 861.664069] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.766268] env[66994]: INFO networking_nsxv3.common.synchronization [req-32d0adb9-a5e4-48d8-b767-eaf37ac1106e req-532dcdd8-3e83-4170-b33b-67f23e14625e service nova] Enqueued Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_rules [ 861.766268] env[66994]: INFO networking_nsxv3.common.synchronization [req-32d0adb9-a5e4-48d8-b767-eaf37ac1106e req-532dcdd8-3e83-4170-b33b-67f23e14625e service nova] Enqueued Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 861.766268] env[66994]: INFO networking_nsxv3.common.synchronization [req-32d0adb9-a5e4-48d8-b767-eaf37ac1106e req-532dcdd8-3e83-4170-b33b-67f23e14625e service nova] Enqueued Resource ID: 85ceac25-fbe3-44bf-8c43-d2a4deb91531 with Priority: HIGHEST for action port [ 861.767376] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_rules [ 861.767942] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 861.768251] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85ceac25-fbe3-44bf-8c43-d2a4deb91531 with Priority: HIGHEST for action port [ 861.769143] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.769572] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.769908] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.770322] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.770613] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.772177] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.773284] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.774018] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-85ceac25-fbe3-44bf-8c43-d2a4deb91531 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.774581] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85ceac25-fbe3-44bf-8c43-d2a4deb91531" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.783198] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85ceac25-fbe3-44bf-8c43-d2a4deb91531" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.783198] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85ceac25-fbe3-44bf-8c43-d2a4deb91531" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.783198] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85ceac25-fbe3-44bf-8c43-d2a4deb91531',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.893502] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30ad8345-1835-48d1-b9bf-1e6714d386f1 [ 861.893502] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.893502] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.893502] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.893502] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.893502] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.893730] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30ad8345-1835-48d1-b9bf-1e6714d386f1 already deleted. [ 861.893730] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30ad8345-1835-48d1-b9bf-1e6714d386f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.281216] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.281359] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.283772] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85ceac25-fbe3-44bf-8c43-d2a4deb91531 with status ACTIVE [ 862.283991] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.284288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.284288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.284415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.284557] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.285056] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.285056] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.285056] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.285056] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.285056] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.285293] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.285358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.285358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.285505] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.286517] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.286517] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85ceac25-fbe3-44bf-8c43-d2a4deb91531 is going to be updated. [ 862.311094] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.311094] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.311094] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.311094] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.311094] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.311546] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85ceac25-fbe3-44bf-8c43-d2a4deb91531" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.611241] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: SUCCESS [ 862.611241] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e deletion is rescheduled due to dependency. [ 862.611241] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.611241] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.611241] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.611241] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.611241] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.611241] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.611241] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.611241] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.611241] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.113498] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.616387] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.644097] env[66994]: INFO networking_nsxv3.common.synchronization [None req-5b75030a-23e1-4a73-a0ec-a5ac9d5a9185 None None] Enqueued Resource ID: c13eaaf9-11b2-4eea-b0b0-d37949982e36 with Priority: HIGHEST for action port [ 863.644559] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c13eaaf9-11b2-4eea-b0b0-d37949982e36 with Priority: HIGHEST for action port [ 863.644906] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-c13eaaf9-11b2-4eea-b0b0-d37949982e36 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.646654] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c13eaaf9-11b2-4eea-b0b0-d37949982e36" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.647893] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c13eaaf9-11b2-4eea-b0b0-d37949982e36" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.648267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c13eaaf9-11b2-4eea-b0b0-d37949982e36" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.648361] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c13eaaf9-11b2-4eea-b0b0-d37949982e36',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.120068] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.120364] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.120364] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.120547] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.120547] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.120704] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e is going to be updated. [ 864.154273] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c13eaaf9-11b2-4eea-b0b0-d37949982e36 [ 864.154273] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.155295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.155295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.155659] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.155659] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.155800] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c13eaaf9-11b2-4eea-b0b0-d37949982e36 already deleted. [ 864.155919] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c13eaaf9-11b2-4eea-b0b0-d37949982e36" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.160239] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.161053] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.161053] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.161053] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.161053] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.174963] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: IN_PROGRESS for 2s [ 865.214361] env[66994]: INFO networking_nsxv3.common.synchronization [None req-d54347b0-6d39-4eb7-9bc5-80834483810e None None] Enqueued Resource ID: 5ddef7fa-ebf7-47bd-a9d5-1a9e8ea87179 with Priority: HIGHEST for action port [ 865.214769] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ddef7fa-ebf7-47bd-a9d5-1a9e8ea87179 with Priority: HIGHEST for action port [ 865.215203] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ddef7fa-ebf7-47bd-a9d5-1a9e8ea87179 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.215331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ddef7fa-ebf7-47bd-a9d5-1a9e8ea87179" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.215401] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ddef7fa-ebf7-47bd-a9d5-1a9e8ea87179" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.215665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ddef7fa-ebf7-47bd-a9d5-1a9e8ea87179" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.215791] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ddef7fa-ebf7-47bd-a9d5-1a9e8ea87179',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.717984] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ddef7fa-ebf7-47bd-a9d5-1a9e8ea87179 [ 865.718347] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.718471] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.718523] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.718959] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.720103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.720103] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ddef7fa-ebf7-47bd-a9d5-1a9e8ea87179 already deleted. [ 865.720395] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ddef7fa-ebf7-47bd-a9d5-1a9e8ea87179" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.188122] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: SUCCESS [ 866.188122] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.188122] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.189284] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.189284] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.189284] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.189284] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.189284] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.189284] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.189284] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.189566] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.696445] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.696445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.696445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.696445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.696445] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.696445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.696445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.696445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.696445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.696445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.696445] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.696445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.696445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.696445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.696445] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.696445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.697462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.697462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.697462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.697462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.697462] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.199777] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88bd36a2-b7c7-405c-ba4b-c36eb190f52e: rpc.has_security_group_logging(os_id): False [ 867.224456] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.224674] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.224801] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.225088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.225219] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.225476] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.225829] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.225829] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.225829] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.225963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.226140] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.226262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.226327] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.226497] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.226576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.226759] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.226890] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.226933] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.227084] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.227169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.227267] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e is going to be updated. [ 867.288824] env[66994]: INFO networking_nsxv3.common.synchronization [None req-f47d0263-7ae0-4973-87e4-78c316e66d46 None None] Enqueued Resource ID: 95c7ba46-b44e-45c3-af0f-4ceebe0e32ea with Priority: HIGHEST for action port [ 867.289593] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95c7ba46-b44e-45c3-af0f-4ceebe0e32ea with Priority: HIGHEST for action port [ 867.290140] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-95c7ba46-b44e-45c3-af0f-4ceebe0e32ea taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.291558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95c7ba46-b44e-45c3-af0f-4ceebe0e32ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.291672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95c7ba46-b44e-45c3-af0f-4ceebe0e32ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.291980] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95c7ba46-b44e-45c3-af0f-4ceebe0e32ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.292173] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95c7ba46-b44e-45c3-af0f-4ceebe0e32ea',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.307612] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.307817] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.307865] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.308159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.308326] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.328508] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: IN_PROGRESS for 2s [ 867.794398] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95c7ba46-b44e-45c3-af0f-4ceebe0e32ea [ 867.796670] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.796670] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.796670] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.796670] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.796670] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.796670] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95c7ba46-b44e-45c3-af0f-4ceebe0e32ea already deleted. [ 867.796670] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95c7ba46-b44e-45c3-af0f-4ceebe0e32ea" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.231689] env[66994]: INFO networking_nsxv3.common.synchronization [None req-daf48c31-6833-4fe2-8926-1ba285317f2b None None] Enqueued Resource ID: b302903c-a4c7-4e87-a274-cb04694bb4c9 with Priority: HIGHEST for action port [ 868.232019] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b302903c-a4c7-4e87-a274-cb04694bb4c9 with Priority: HIGHEST for action port [ 868.232228] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-b302903c-a4c7-4e87-a274-cb04694bb4c9 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.233017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b302903c-a4c7-4e87-a274-cb04694bb4c9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.233017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b302903c-a4c7-4e87-a274-cb04694bb4c9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.233017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b302903c-a4c7-4e87-a274-cb04694bb4c9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.233017] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b302903c-a4c7-4e87-a274-cb04694bb4c9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.735491] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b302903c-a4c7-4e87-a274-cb04694bb4c9 [ 868.737255] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.737255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.737255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.737255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.737255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.737478] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b302903c-a4c7-4e87-a274-cb04694bb4c9 already deleted. [ 868.737478] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b302903c-a4c7-4e87-a274-cb04694bb4c9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.889685] env[66994]: INFO networking_nsxv3.common.synchronization [req-518c2c6a-520c-462c-8a5a-5b8ef29d39ec req-41aec804-a129-43b7-92ec-32e632fccd9f tempest-ImagesOneServerNegativeTestJSON-1432587522 tempest-ImagesOneServerNegativeTestJSON-1432587522-project-member] Enqueued Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_members [ 868.889685] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGHEST for action security_group_members [ 868.890050] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-11c0b684-9731-4046-89ad-f4bf7b2168d4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.892513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.892513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.892513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.892513] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.892513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.892513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.892513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.892924] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.892924] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.345177] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: SUCCESS [ 869.346010] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.396361] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.396797] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.396899] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.397190] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.397308] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.397503] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.397919] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.397919] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.397919] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.397919] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.398082] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 is going to be updated. [ 869.435039] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.435255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.435255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.435533] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.435651] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.445872] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 in Status: IN_PROGRESS for 2s [ 870.964149] env[66994]: INFO networking_nsxv3.common.synchronization [None req-f3b4b6ff-7af5-4979-8cea-cf82c992ae32 None None] Enqueued Resource ID: 50df31eb-391b-4d8c-b18b-30dd668f8b7a with Priority: HIGHEST for action port [ 870.964691] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50df31eb-391b-4d8c-b18b-30dd668f8b7a with Priority: HIGHEST for action port [ 870.966085] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-50df31eb-391b-4d8c-b18b-30dd668f8b7a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.966085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50df31eb-391b-4d8c-b18b-30dd668f8b7a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.966085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50df31eb-391b-4d8c-b18b-30dd668f8b7a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.966085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50df31eb-391b-4d8c-b18b-30dd668f8b7a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.966085] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50df31eb-391b-4d8c-b18b-30dd668f8b7a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.460555] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 in Status: SUCCESS [ 871.460757] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 deletion is rescheduled due to dependency. [ 871.460875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.467822] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50df31eb-391b-4d8c-b18b-30dd668f8b7a [ 871.468159] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.468407] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.468407] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.468567] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.468659] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.468767] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50df31eb-391b-4d8c-b18b-30dd668f8b7a already deleted. [ 871.468836] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50df31eb-391b-4d8c-b18b-30dd668f8b7a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.179083] env[66994]: INFO networking_nsxv3.common.synchronization [req-32cdb286-a33e-44c2-b028-c2197be04d8f req-1da68602-e675-416c-93f4-61528cafd981 tempest-ListServerFiltersTestJSON-483871491 tempest-ListServerFiltersTestJSON-483871491-project-member] Enqueued Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_members [ 873.179733] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGHEST for action security_group_members [ 873.180734] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.181652] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.181652] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.181652] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.181652] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.181652] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.181652] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.181943] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.182108] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.182515] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.686285] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.686285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.686285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.686285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.686285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.686285] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.686285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.686285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.686285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.686285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.686285] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb is going to be updated. [ 873.717679] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.717847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.717905] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.718229] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.718403] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.728247] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: IN_PROGRESS for 2s [ 873.915710] env[66994]: INFO networking_nsxv3.common.synchronization [req-215278d2-a260-4644-ab2c-7d7326cdecb5 req-c2025384-2bad-40bc-a686-0c0a18957dfd tempest-ServersWithSpecificFlavorTestJSON-500627254 tempest-ServersWithSpecificFlavorTestJSON-500627254-project-member] Enqueued Resource ID: a6612b52-6412-47ab-8918-14b6b8bca0cb with Priority: HIGHEST for action security_group_members [ 873.916550] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6612b52-6412-47ab-8918-14b6b8bca0cb with Priority: HIGHEST for action security_group_members [ 873.916927] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6612b52-6412-47ab-8918-14b6b8bca0cb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.917071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.917154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.917359] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.917508] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.917625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.917730] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.917938] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.918046] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.918143] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6612b52-6412-47ab-8918-14b6b8bca0cb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.273676] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-822 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.274076] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-822" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.274288] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-822" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.274712] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-822" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.275106] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.275322] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.275477] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.275800] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.276425] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.276425] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 874.276425] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 874.276604] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 874.276604] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 874.276656] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 874.276768] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 874.276901] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 874.301462] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 874.301725] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 874.301785] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 874.301935] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-822" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.302308] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-36990a24-da42-491e-a67f-1fcd1c224751 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.302484] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-36990a24-da42-491e-a67f-1fcd1c224751" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.302603] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-36990a24-da42-491e-a67f-1fcd1c224751" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.302981] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-36990a24-da42-491e-a67f-1fcd1c224751" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.303178] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36990a24-da42-491e-a67f-1fcd1c224751',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.341903] env[66994]: INFO networking_nsxv3.common.synchronization [None req-71495b11-269a-49f5-97fd-92d12e653008 None None] Enqueued Resource ID: 4f2ef77b-f439-450d-88d1-d3030db663e5 with Priority: HIGHEST for action port [ 874.342427] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f2ef77b-f439-450d-88d1-d3030db663e5 with Priority: HIGHEST for action port [ 874.347366] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f2ef77b-f439-450d-88d1-d3030db663e5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.347366] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f2ef77b-f439-450d-88d1-d3030db663e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.347366] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f2ef77b-f439-450d-88d1-d3030db663e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.347366] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f2ef77b-f439-450d-88d1-d3030db663e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.347366] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f2ef77b-f439-450d-88d1-d3030db663e5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.420636] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.420850] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.420977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.421309] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.421437] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.421784] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.421871] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.421871] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.422050] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.422120] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.422198] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6612b52-6412-47ab-8918-14b6b8bca0cb is going to be updated. [ 874.450041] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.450201] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.450329] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.450471] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.450654] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.460618] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6612b52-6412-47ab-8918-14b6b8bca0cb in Status: IN_PROGRESS for 2s [ 874.808664] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.808801] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.808928] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.809242] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.809408] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.809580] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 36990a24-da42-491e-a67f-1fcd1c224751 not found, creating... [ 874.809838] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.810042] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.810213] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.810529] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.810736] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.811019] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.811196] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.811309] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.811525] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.811647] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.811798] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 36990a24-da42-491e-a67f-1fcd1c224751 is going to be created. [ 874.835387] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.835615] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.835761] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.836332] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.836573] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.836912] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-36990a24-da42-491e-a67f-1fcd1c224751" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.851629] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f2ef77b-f439-450d-88d1-d3030db663e5 [ 874.851852] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.851980] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.852086] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.852306] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.852392] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.852487] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f2ef77b-f439-450d-88d1-d3030db663e5 already deleted. [ 874.852562] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f2ef77b-f439-450d-88d1-d3030db663e5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.622367] env[66994]: INFO networking_nsxv3.common.synchronization [req-215278d2-a260-4644-ab2c-7d7326cdecb5 req-cb5b3e1b-1e86-465d-982d-1edacbe26591 service nova] Enqueued Resource ID: a6612b52-6412-47ab-8918-14b6b8bca0cb with Priority: HIGHEST for action security_group_rules [ 875.622367] env[66994]: INFO networking_nsxv3.common.synchronization [req-215278d2-a260-4644-ab2c-7d7326cdecb5 req-cb5b3e1b-1e86-465d-982d-1edacbe26591 service nova] Enqueued Resource ID: a6612b52-6412-47ab-8918-14b6b8bca0cb with Priority: HIGHEST for action security_group_members [ 875.622367] env[66994]: INFO networking_nsxv3.common.synchronization [req-215278d2-a260-4644-ab2c-7d7326cdecb5 req-cb5b3e1b-1e86-465d-982d-1edacbe26591 service nova] Enqueued Resource ID: 36990a24-da42-491e-a67f-1fcd1c224751 with Priority: HIGHEST for action port [ 875.626153] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6612b52-6412-47ab-8918-14b6b8bca0cb with Priority: HIGHEST for action security_group_rules [ 875.626153] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6612b52-6412-47ab-8918-14b6b8bca0cb with Priority: HIGHEST for action security_group_members [ 875.626153] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36990a24-da42-491e-a67f-1fcd1c224751 with Priority: HIGHEST for action port [ 875.626153] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6612b52-6412-47ab-8918-14b6b8bca0cb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.626153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.626153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.626153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.626153] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6612b52-6412-47ab-8918-14b6b8bca0cb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.626153] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6612b52-6412-47ab-8918-14b6b8bca0cb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.626494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.626494] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-36990a24-da42-491e-a67f-1fcd1c224751 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.626590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36990a24-da42-491e-a67f-1fcd1c224751" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.626590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36990a24-da42-491e-a67f-1fcd1c224751" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.626768] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36990a24-da42-491e-a67f-1fcd1c224751" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.626853] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36990a24-da42-491e-a67f-1fcd1c224751',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.743144] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb in Status: SUCCESS [ 875.743374] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb deletion is rescheduled due to dependency. [ 875.743496] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.132029] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6612b52-6412-47ab-8918-14b6b8bca0cb taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.132168] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.132714] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36990a24-da42-491e-a67f-1fcd1c224751 with status ACTIVE [ 876.132714] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.132714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.133806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.133806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.133806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.133806] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.133806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.133806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.133806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.133806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.133806] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.134173] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.134173] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.134308] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.134401] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.134496] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36990a24-da42-491e-a67f-1fcd1c224751 is going to be updated. [ 876.157193] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.157193] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.157377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.157502] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.157632] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.157800] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36990a24-da42-491e-a67f-1fcd1c224751" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.473182] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6612b52-6412-47ab-8918-14b6b8bca0cb in Status: SUCCESS [ 876.473341] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6612b52-6412-47ab-8918-14b6b8bca0cb deletion is rescheduled due to dependency. [ 876.473482] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.473681] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.473943] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.474230] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.474362] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.474439] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.474610] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.474708] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.474861] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6612b52-6412-47ab-8918-14b6b8bca0cb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.978057] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6612b52-6412-47ab-8918-14b6b8bca0cb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.986634] env[66994]: INFO networking_nsxv3.common.synchronization [None req-a15ef7f0-bcb3-47b0-b51d-71c41d694704 None None] Enqueued Resource ID: 82cd4281-f491-41cb-be15-b7e63a1983e7 with Priority: HIGHEST for action port [ 876.987334] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82cd4281-f491-41cb-be15-b7e63a1983e7 with Priority: HIGHEST for action port [ 876.987838] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-82cd4281-f491-41cb-be15-b7e63a1983e7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.987953] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82cd4281-f491-41cb-be15-b7e63a1983e7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.988099] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82cd4281-f491-41cb-be15-b7e63a1983e7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.988415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82cd4281-f491-41cb-be15-b7e63a1983e7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.988497] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82cd4281-f491-41cb-be15-b7e63a1983e7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.481443] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6612b52-6412-47ab-8918-14b6b8bca0cb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.491626] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82cd4281-f491-41cb-be15-b7e63a1983e7 [ 877.494127] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.494127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.494127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.494127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.494127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.494127] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82cd4281-f491-41cb-be15-b7e63a1983e7 already deleted. [ 877.494127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82cd4281-f491-41cb-be15-b7e63a1983e7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.985426] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.985426] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.985426] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.985426] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.985857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.985857] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6612b52-6412-47ab-8918-14b6b8bca0cb is going to be updated. [ 878.017830] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.018030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.018030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.018496] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.018496] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.037968] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6612b52-6412-47ab-8918-14b6b8bca0cb in Status: IN_PROGRESS for 2s [ 879.326553] env[66994]: INFO networking_nsxv3.common.synchronization [req-5482030e-aee3-40a7-96cd-59f24f8b8859 req-65c07cb9-a329-4793-a586-0d9febb82e84 tempest-ServerActionsV293TestJSON-570448108 tempest-ServerActionsV293TestJSON-570448108-project-member] Enqueued Resource ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b with Priority: HIGHEST for action security_group_members [ 879.327106] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b with Priority: HIGHEST for action security_group_members [ 879.327441] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.327568] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.327635] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.327840] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.327995] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.328115] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.328177] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.328321] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.328407] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.328499] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4672e8d-a5ca-46f8-8d7b-adf4da6e472b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.832176] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.832347] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.832415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.832936] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.860025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.860025] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.860025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.860025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.860025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.860025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.860025] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b is going to be updated. [ 879.895642] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.896395] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.896611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.896977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.902456] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.914341] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b in Status: IN_PROGRESS for 2s [ 880.052061] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6612b52-6412-47ab-8918-14b6b8bca0cb in Status: SUCCESS [ 880.052309] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.052493] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.052721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.053689] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.053881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.053938] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.054162] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.054256] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.054352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.054465] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6612b52-6412-47ab-8918-14b6b8bca0cb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.561037] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6612b52-6412-47ab-8918-14b6b8bca0cb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.061778] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6612b52-6412-47ab-8918-14b6b8bca0cb: rpc.has_security_group_logging(os_id): False [ 881.086268] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.086512] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.089354] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.089682] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.090156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.090864] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.090864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.090864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.091024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.091287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.091287] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6612b52-6412-47ab-8918-14b6b8bca0cb is going to be updated. [ 881.148929] env[66994]: INFO networking_nsxv3.common.synchronization [None req-fbbc345c-f803-4dcb-a40e-90b68b493127 None None] Enqueued Resource ID: 5871fc5d-9d39-46f3-895c-a192f35e9f03 with Priority: HIGHEST for action port [ 881.151965] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5871fc5d-9d39-46f3-895c-a192f35e9f03 with Priority: HIGHEST for action port [ 881.152365] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-5871fc5d-9d39-46f3-895c-a192f35e9f03 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.152498] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5871fc5d-9d39-46f3-895c-a192f35e9f03" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.153561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5871fc5d-9d39-46f3-895c-a192f35e9f03" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.157024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5871fc5d-9d39-46f3-895c-a192f35e9f03" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.157024] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5871fc5d-9d39-46f3-895c-a192f35e9f03',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.157024] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.157024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.157024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.157024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.157024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.176521] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6612b52-6412-47ab-8918-14b6b8bca0cb in Status: IN_PROGRESS for 2s [ 881.663198] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5871fc5d-9d39-46f3-895c-a192f35e9f03 [ 881.663418] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.663533] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.663590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.663808] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.664068] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.664068] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5871fc5d-9d39-46f3-895c-a192f35e9f03 already deleted. [ 881.664068] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5871fc5d-9d39-46f3-895c-a192f35e9f03" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.827795] env[66994]: INFO networking_nsxv3.common.synchronization [req-e6015ac3-098b-42e9-ba25-92ab8b2fba1e req-34b8437d-e89b-4c71-bfbb-649ba38a4a03 tempest-MigrationsAdminTest-2127426748 tempest-MigrationsAdminTest-2127426748-project-member] Enqueued Resource ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d with Priority: HIGHEST for action security_group_members [ 881.830169] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d with Priority: HIGHEST for action security_group_members [ 881.830169] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.830169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.830169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.830169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.830169] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.830169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.830169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.830169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.830169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.830169] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.916024] env[66994]: INFO networking_nsxv3.common.synchronization [req-69bf601e-b933-45ea-9116-9e46b5fcce90 req-f0479800-23e2-428f-ae54-36ca53a049ba tempest-ServerDiskConfigTestJSON-2121377508 tempest-ServerDiskConfigTestJSON-2121377508-project-member] Enqueued Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 881.918730] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 881.919508] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.919649] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.919913] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.920045] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.920115] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.920181] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.920251] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.920434] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.921769] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.921769] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.948266] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b in Status: SUCCESS [ 881.948266] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b deletion is rescheduled due to dependency. [ 881.948348] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.335553] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.354780] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.354970] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.355102] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.355313] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.355561] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.355730] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.355822] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.356062] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.356204] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.357330] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 882.357330] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 882.357330] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 882.357330] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 882.357330] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 882.357330] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 882.357330] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 882.376777] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 882.376960] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 882.377114] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 882.377315] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-281" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.377627] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-344af28c-7821-42c3-ae08-2bba56154d26 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.377792] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-344af28c-7821-42c3-ae08-2bba56154d26" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.377908] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-344af28c-7821-42c3-ae08-2bba56154d26" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.378254] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-344af28c-7821-42c3-ae08-2bba56154d26" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.378465] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('344af28c-7821-42c3-ae08-2bba56154d26',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.424392] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.424392] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.424392] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.424392] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.430760] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.430760] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.430760] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.430760] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.430760] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.430760] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.430760] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 is going to be updated. [ 882.458553] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.458553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.458553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.458553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.458553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.469807] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: IN_PROGRESS for 2s [ 882.838999] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.881927] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.882178] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.882306] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.882587] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.882737] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.882894] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 344af28c-7821-42c3-ae08-2bba56154d26 not found, creating... [ 882.883185] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.883325] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.883440] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.883654] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.883788] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.884094] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.884278] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.884395] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.884627] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.884720] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.884856] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 344af28c-7821-42c3-ae08-2bba56154d26 is going to be created. [ 882.906801] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.907011] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.907146] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.907415] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.907632] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.907853] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-344af28c-7821-42c3-ae08-2bba56154d26" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.214302] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6612b52-6412-47ab-8918-14b6b8bca0cb in Status: SUCCESS [ 883.214302] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.346379] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.346379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.346379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.346379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.346379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.346379] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d is going to be updated. [ 883.379162] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.379162] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.379162] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.379682] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.380702] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.393082] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d in Status: IN_PROGRESS for 2s [ 883.717346] env[66994]: INFO networking_nsxv3.common.synchronization [req-e6015ac3-098b-42e9-ba25-92ab8b2fba1e req-9600a101-cebc-449a-b5e1-364a985f4851 service nova] Enqueued Resource ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d with Priority: HIGHEST for action security_group_rules [ 883.717346] env[66994]: INFO networking_nsxv3.common.synchronization [req-e6015ac3-098b-42e9-ba25-92ab8b2fba1e req-9600a101-cebc-449a-b5e1-364a985f4851 service nova] Enqueued Resource ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d with Priority: HIGHEST for action security_group_members [ 883.717346] env[66994]: INFO networking_nsxv3.common.synchronization [req-e6015ac3-098b-42e9-ba25-92ab8b2fba1e req-9600a101-cebc-449a-b5e1-364a985f4851 service nova] Enqueued Resource ID: 344af28c-7821-42c3-ae08-2bba56154d26 with Priority: HIGHEST for action port [ 883.717886] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d with Priority: HIGHEST for action security_group_rules [ 883.717886] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d with Priority: HIGHEST for action security_group_members [ 883.718013] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 344af28c-7821-42c3-ae08-2bba56154d26 with Priority: HIGHEST for action port [ 883.719237] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc9a0c95-f9f4-4eb7-a275-05d69816e71d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.719683] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.719832] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.720074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.720249] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.723761] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.723761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.723761] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-344af28c-7821-42c3-ae08-2bba56154d26 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.723761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-344af28c-7821-42c3-ae08-2bba56154d26" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.723761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-344af28c-7821-42c3-ae08-2bba56154d26" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.723761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-344af28c-7821-42c3-ae08-2bba56154d26" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.726012] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('344af28c-7821-42c3-ae08-2bba56154d26',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.756723] env[66994]: INFO networking_nsxv3.common.synchronization [None req-2204ad12-6372-4203-8266-588c5da9dc91 None None] Enqueued Resource ID: 1971db47-062c-4dea-b984-ef7b3eaf23c4 with Priority: HIGHEST for action port [ 883.757508] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1971db47-062c-4dea-b984-ef7b3eaf23c4 with Priority: HIGHEST for action port [ 883.758293] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-1971db47-062c-4dea-b984-ef7b3eaf23c4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.758363] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1971db47-062c-4dea-b984-ef7b3eaf23c4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.758852] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1971db47-062c-4dea-b984-ef7b3eaf23c4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.758852] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1971db47-062c-4dea-b984-ef7b3eaf23c4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.758852] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1971db47-062c-4dea-b984-ef7b3eaf23c4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.230289] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 344af28c-7821-42c3-ae08-2bba56154d26 with status ACTIVE [ 884.230289] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.230289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.230289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.230289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.230289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.230289] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.230289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.230289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.230289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.230289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.230289] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.230289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.230289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.230946] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.232251] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.232251] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 344af28c-7821-42c3-ae08-2bba56154d26 is going to be updated. [ 884.233631] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.233716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.255699] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.255868] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.255942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.256180] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.256303] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.256458] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-344af28c-7821-42c3-ae08-2bba56154d26" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.261232] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1971db47-062c-4dea-b984-ef7b3eaf23c4 [ 884.261450] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.261656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.261656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.263235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.263235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.263235] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1971db47-062c-4dea-b984-ef7b3eaf23c4 already deleted. [ 884.263235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1971db47-062c-4dea-b984-ef7b3eaf23c4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.487278] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: SUCCESS [ 884.488092] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 deletion is rescheduled due to dependency. [ 884.488092] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.404425] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d in Status: SUCCESS [ 885.404770] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.405565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.405873] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.406492] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.406492] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.406492] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.406679] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.407995] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.407995] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.911096] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.419424] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.919637] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.919708] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.919767] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.919982] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.920105] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.920211] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d is going to be updated. [ 886.964444] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.964652] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.964741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.965013] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.965181] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.976984] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d in Status: IN_PROGRESS for 2s [ 887.961541] env[66994]: INFO networking_nsxv3.common.synchronization [req-289f5e22-b4f5-4ca7-8560-1a74037e338f req-eca5635e-556e-4bbb-9304-dbef95f2f607 tempest-ServersTestManualDisk-463487739 tempest-ServersTestManualDisk-463487739-project-member] Enqueued Resource ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e with Priority: HIGHEST for action security_group_members [ 887.961765] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e with Priority: HIGHEST for action security_group_members [ 887.963386] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.963559] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.963598] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.965133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.965133] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.965133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.965133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.965133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.965410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.965410] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7c25236-fc58-43cd-bd73-8bca62dfbd5e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.468869] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.468869] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.468869] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.469749] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.470020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.470095] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.470205] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.470267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.470769] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.470769] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.470769] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e is going to be updated. [ 888.502396] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.502589] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.502714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.504126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.504126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.514616] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e in Status: IN_PROGRESS for 2s [ 888.989861] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d in Status: SUCCESS [ 888.990157] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.990281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.990522] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.990690] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.991400] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.991400] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.991400] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.991400] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.991400] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.991642] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.494823] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.495739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.495739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.495739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.495739] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.495739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.495739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.496791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.496791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.496791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.496791] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.496791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.496791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.496791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.496791] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.496791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.496791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.497475] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.497475] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.497475] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.497475] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.003437] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc9a0c95-f9f4-4eb7-a275-05d69816e71d: rpc.has_security_group_logging(os_id): False [ 890.029975] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.030156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.030245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.030469] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.030565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.030775] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.030873] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.030937] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.031109] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.031193] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.031437] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.031546] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.031646] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.031744] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.031838] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.031989] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.032095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.032155] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.032368] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.033091] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.033091] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d is going to be updated. [ 890.104823] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.105051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.105146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.105357] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.105514] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.122620] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d in Status: IN_PROGRESS for 2s [ 890.525921] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e in Status: SUCCESS [ 890.526107] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e deletion is rescheduled due to dependency. [ 890.526149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.724595] env[66994]: INFO networking_nsxv3.common.synchronization [None req-3c44a4ff-71a7-4632-b4c2-bdfb5d73709d None None] Enqueued Resource ID: 92956acd-95e3-4b85-ba3b-07e173202322 with Priority: HIGHEST for action port [ 890.725915] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92956acd-95e3-4b85-ba3b-07e173202322 with Priority: HIGHEST for action port [ 890.725915] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-92956acd-95e3-4b85-ba3b-07e173202322 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.725915] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92956acd-95e3-4b85-ba3b-07e173202322" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.725915] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92956acd-95e3-4b85-ba3b-07e173202322" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.727206] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92956acd-95e3-4b85-ba3b-07e173202322" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.727352] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92956acd-95e3-4b85-ba3b-07e173202322',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.229405] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92956acd-95e3-4b85-ba3b-07e173202322 [ 891.229664] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.232447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.232447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.232447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.232447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.232447] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92956acd-95e3-4b85-ba3b-07e173202322 already deleted. [ 891.232447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92956acd-95e3-4b85-ba3b-07e173202322" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.140160] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d in Status: SUCCESS [ 892.140430] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.013195] env[66994]: INFO networking_nsxv3.common.synchronization [None req-9b76715a-0ce8-4884-aad2-8dc551ed5995 None None] Enqueued Resource ID: 5ff3ca24-a103-4788-a46f-40caeb4bad47 with Priority: HIGHEST for action port [ 893.017558] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ff3ca24-a103-4788-a46f-40caeb4bad47 with Priority: HIGHEST for action port [ 893.017558] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ff3ca24-a103-4788-a46f-40caeb4bad47 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.017558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ff3ca24-a103-4788-a46f-40caeb4bad47" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.017558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ff3ca24-a103-4788-a46f-40caeb4bad47" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.017558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ff3ca24-a103-4788-a46f-40caeb4bad47" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.017558] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ff3ca24-a103-4788-a46f-40caeb4bad47',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.301282] env[66994]: INFO networking_nsxv3.common.synchronization [req-7f4d3e4f-3fff-4d8b-bd87-e74d803b471b req-f93f49d2-c9d2-4724-b615-7b26c0162a39 tempest-ServersAdminTestJSON-1722983547 tempest-ServersAdminTestJSON-1722983547-project-member] Enqueued Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 893.301824] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 893.302201] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.302345] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.302435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.303846] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.304087] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.304263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.304405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.304607] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.304728] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.304854] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.517622] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ff3ca24-a103-4788-a46f-40caeb4bad47 [ 893.518578] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.518578] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.518578] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.518578] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.518857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.518857] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ff3ca24-a103-4788-a46f-40caeb4bad47 already deleted. [ 893.518857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ff3ca24-a103-4788-a46f-40caeb4bad47" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.806670] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.309901] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.599778] env[66994]: INFO networking_nsxv3.common.synchronization [req-9aaa2e73-5227-4c87-8a8e-2ee9c9a8252b req-72071f47-ff49-42ef-accf-07c27529cab8 tempest-ImagesTestJSON-691407333 tempest-ImagesTestJSON-691407333-project-member] Enqueued Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 894.601077] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 894.601544] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.601737] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.601811] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.602135] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.602196] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.602268] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.602334] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.602485] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.602570] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.602666] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.811225] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.811399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.811439] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.811643] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.811729] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.811823] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 is going to be updated. [ 894.843803] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.843941] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.844018] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.844279] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.844485] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.853415] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: IN_PROGRESS for 2s [ 895.020946] env[66994]: INFO networking_nsxv3.common.synchronization [None req-ff36ead6-f6bf-4888-a7fc-68ca974f7642 None None] Enqueued Resource ID: 1cb3b665-78f9-49fb-903c-aafba7fbc4ee with Priority: HIGHEST for action port [ 895.023103] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cb3b665-78f9-49fb-903c-aafba7fbc4ee with Priority: HIGHEST for action port [ 895.023103] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-1cb3b665-78f9-49fb-903c-aafba7fbc4ee taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.023103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1cb3b665-78f9-49fb-903c-aafba7fbc4ee" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.023103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1cb3b665-78f9-49fb-903c-aafba7fbc4ee" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.023103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1cb3b665-78f9-49fb-903c-aafba7fbc4ee" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.023444] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cb3b665-78f9-49fb-903c-aafba7fbc4ee',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.105756] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.106210] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.106210] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.106334] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.106442] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.106658] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.106758] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.106821] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.106973] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.107061] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.107150] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e is going to be updated. [ 895.138402] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.140741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.140741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.140741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.140741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.150410] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: IN_PROGRESS for 2s [ 895.525034] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1cb3b665-78f9-49fb-903c-aafba7fbc4ee [ 895.525430] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.525501] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.525544] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.525770] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.525916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.525983] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1cb3b665-78f9-49fb-903c-aafba7fbc4ee already deleted. [ 895.526093] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1cb3b665-78f9-49fb-903c-aafba7fbc4ee" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.865150] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: SUCCESS [ 896.865496] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.161740] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: SUCCESS [ 897.161894] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e deletion is rescheduled due to dependency. [ 897.162063] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.648038] env[66994]: INFO networking_nsxv3.common.synchronization [None req-ec7177d7-dfa4-4872-9358-a22429ea9a3c None None] Enqueued Resource ID: 9ca4d3ba-240a-41d4-a969-ff94e9d5abe0 with Priority: HIGHEST for action port [ 897.648694] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ca4d3ba-240a-41d4-a969-ff94e9d5abe0 with Priority: HIGHEST for action port [ 897.649067] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ca4d3ba-240a-41d4-a969-ff94e9d5abe0 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.649188] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ca4d3ba-240a-41d4-a969-ff94e9d5abe0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.649406] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ca4d3ba-240a-41d4-a969-ff94e9d5abe0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.649501] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ca4d3ba-240a-41d4-a969-ff94e9d5abe0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.649585] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ca4d3ba-240a-41d4-a969-ff94e9d5abe0',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.155705] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ca4d3ba-240a-41d4-a969-ff94e9d5abe0 [ 898.155705] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.155705] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.155705] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.156076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.156076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.156076] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ca4d3ba-240a-41d4-a969-ff94e9d5abe0 already deleted. [ 898.156193] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ca4d3ba-240a-41d4-a969-ff94e9d5abe0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.205480] env[66994]: INFO networking_nsxv3.common.synchronization [None req-56279875-0cc2-4bcc-af42-8b115e96d3c7 None None] Enqueued Resource ID: fb35b472-fdae-4f02-830b-42c87da82afe with Priority: HIGHEST for action port [ 898.206053] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb35b472-fdae-4f02-830b-42c87da82afe with Priority: HIGHEST for action port [ 898.208075] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb35b472-fdae-4f02-830b-42c87da82afe taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.208075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb35b472-fdae-4f02-830b-42c87da82afe" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.208075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb35b472-fdae-4f02-830b-42c87da82afe" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.208252] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb35b472-fdae-4f02-830b-42c87da82afe" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.208283] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb35b472-fdae-4f02-830b-42c87da82afe',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.711398] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb35b472-fdae-4f02-830b-42c87da82afe [ 898.711664] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.711764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.711837] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.712106] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.712241] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.712348] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb35b472-fdae-4f02-830b-42c87da82afe already deleted. [ 898.712434] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb35b472-fdae-4f02-830b-42c87da82afe" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.993494] env[66994]: INFO networking_nsxv3.common.synchronization [None req-c2309c86-af14-4bde-b13a-769a2847397d tempest-AttachVolumeNegativeTest-1341698298 tempest-AttachVolumeNegativeTest-1341698298-project-member] Enqueued Resource ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f with Priority: HIGHEST for action security_group_rules [ 898.993913] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f with Priority: HIGHEST for action security_group_rules [ 898.994243] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.994360] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.994426] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.994679] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.994982] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dbf99f5-e2f2-4d4a-a2c0-855c798d247f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.090849] env[66994]: INFO networking_nsxv3.common.synchronization [None req-8596287c-ce33-4b80-b597-4fcc5b754247 tempest-AttachVolumeNegativeTest-1341698298 tempest-AttachVolumeNegativeTest-1341698298-project-member] Enqueued Resource ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f with Priority: HIGHEST for action security_group_rules [ 899.091311] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f with Priority: HIGHEST for action security_group_rules [ 899.091617] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.091711] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.175123] env[66994]: INFO networking_nsxv3.common.synchronization [req-c29b0b5d-279a-41ff-b275-5d7c7b229a03 req-c274833a-8d6c-48c9-8b26-8cb251cf578f tempest-ServersNegativeTestMultiTenantJSON-1862468065 tempest-ServersNegativeTestMultiTenantJSON-1862468065-project-member] Enqueued Resource ID: 30dd50aa-556a-4adf-a58a-c76defad2778 with Priority: HIGHEST for action security_group_members [ 899.175123] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30dd50aa-556a-4adf-a58a-c76defad2778 with Priority: HIGHEST for action security_group_members [ 899.175123] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-30dd50aa-556a-4adf-a58a-c76defad2778 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.175123] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.175123] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.179327] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.179819] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.180253] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.180386] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.180613] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.180747] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.180886] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30dd50aa-556a-4adf-a58a-c76defad2778',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.522345] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.522942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.522942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.523110] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.523694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.523694] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f already deleted. [ 899.523694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.523694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.523694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.524059] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dbf99f5-e2f2-4d4a-a2c0-855c798d247f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.556573] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.556789] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-573" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.556923] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-573" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.557843] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-573" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.557843] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.558220] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.558220] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.558359] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.558538] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.558892] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 899.559271] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 899.559271] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 899.559271] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 899.559375] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 899.559489] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 899.559677] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.580855] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.581060] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 899.581189] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.581425] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-573" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.581753] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-90abd376-d77a-4138-a64c-54abb730eeb0 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.581925] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-90abd376-d77a-4138-a64c-54abb730eeb0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.582069] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-90abd376-d77a-4138-a64c-54abb730eeb0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.582484] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-90abd376-d77a-4138-a64c-54abb730eeb0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.582732] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90abd376-d77a-4138-a64c-54abb730eeb0',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.683926] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.684118] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.684192] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.684433] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.684527] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.684738] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.684843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.684897] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.685265] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.685362] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.685453] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30dd50aa-556a-4adf-a58a-c76defad2778 already deleted. [ 899.685532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.047837] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.047837] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.047969] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.048113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.048195] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.048294] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f already deleted. [ 900.048374] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.085735] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.085987] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.086131] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.086418] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.086757] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.086757] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 90abd376-d77a-4138-a64c-54abb730eeb0 not found, creating... [ 900.087532] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.087532] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.087532] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.087532] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.087671] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.090020] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.090020] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.090020] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.090020] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.090020] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.090020] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 90abd376-d77a-4138-a64c-54abb730eeb0 is going to be created. [ 900.110677] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.110677] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.110677] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.110677] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.110677] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.110677] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-90abd376-d77a-4138-a64c-54abb730eeb0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.457789] env[66994]: INFO networking_nsxv3.common.synchronization [None req-79c03866-9063-4fd8-ba69-b09f35196b58 None None] Enqueued Resource ID: 5a23d5a0-7765-48ae-9f5d-eb9b5ef99795 with Priority: HIGHEST for action port [ 900.459391] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a23d5a0-7765-48ae-9f5d-eb9b5ef99795 with Priority: HIGHEST for action port [ 900.459391] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a23d5a0-7765-48ae-9f5d-eb9b5ef99795 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.459391] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a23d5a0-7765-48ae-9f5d-eb9b5ef99795" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.459391] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a23d5a0-7765-48ae-9f5d-eb9b5ef99795" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.459985] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a23d5a0-7765-48ae-9f5d-eb9b5ef99795" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.459985] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a23d5a0-7765-48ae-9f5d-eb9b5ef99795',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.892852] env[66994]: INFO networking_nsxv3.common.synchronization [req-c29b0b5d-279a-41ff-b275-5d7c7b229a03 req-14c64435-54ce-43bc-baa0-b645ab73c3e9 service nova] Enqueued Resource ID: 30dd50aa-556a-4adf-a58a-c76defad2778 with Priority: HIGHEST for action security_group_rules [ 900.893431] env[66994]: INFO networking_nsxv3.common.synchronization [req-c29b0b5d-279a-41ff-b275-5d7c7b229a03 req-14c64435-54ce-43bc-baa0-b645ab73c3e9 service nova] Enqueued Resource ID: 30dd50aa-556a-4adf-a58a-c76defad2778 with Priority: HIGHEST for action security_group_members [ 900.893431] env[66994]: INFO networking_nsxv3.common.synchronization [req-c29b0b5d-279a-41ff-b275-5d7c7b229a03 req-14c64435-54ce-43bc-baa0-b645ab73c3e9 service nova] Enqueued Resource ID: 90abd376-d77a-4138-a64c-54abb730eeb0 with Priority: HIGHEST for action port [ 900.893791] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30dd50aa-556a-4adf-a58a-c76defad2778 with Priority: HIGHEST for action security_group_rules [ 900.893925] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30dd50aa-556a-4adf-a58a-c76defad2778 with Priority: HIGHEST for action security_group_members [ 900.894274] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90abd376-d77a-4138-a64c-54abb730eeb0 with Priority: HIGHEST for action port [ 900.894621] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30dd50aa-556a-4adf-a58a-c76defad2778 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.894750] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.894802] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.895183] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.895183] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30dd50aa-556a-4adf-a58a-c76defad2778',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.898187] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-30dd50aa-556a-4adf-a58a-c76defad2778 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.898310] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.898376] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.898580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.898752] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.898850] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.898908] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.899176] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.899176] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.899237] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30dd50aa-556a-4adf-a58a-c76defad2778',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.902791] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-90abd376-d77a-4138-a64c-54abb730eeb0 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.902791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90abd376-d77a-4138-a64c-54abb730eeb0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.902791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90abd376-d77a-4138-a64c-54abb730eeb0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.902791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90abd376-d77a-4138-a64c-54abb730eeb0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.902791] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90abd376-d77a-4138-a64c-54abb730eeb0',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.964412] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a23d5a0-7765-48ae-9f5d-eb9b5ef99795 [ 900.964594] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.964722] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.964776] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.965178] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.965358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.965517] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a23d5a0-7765-48ae-9f5d-eb9b5ef99795 already deleted. [ 900.965614] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a23d5a0-7765-48ae-9f5d-eb9b5ef99795" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.399228] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-30dd50aa-556a-4adf-a58a-c76defad2778 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.399372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.401713] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30dd50aa-556a-4adf-a58a-c76defad2778',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.403947] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 90abd376-d77a-4138-a64c-54abb730eeb0 with status ACTIVE [ 901.403947] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.403947] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.403947] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.403947] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.404215] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.404215] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.404283] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.404314] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.404526] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.404590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.404707] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.404833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.404927] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.405173] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.405244] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.405328] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 90abd376-d77a-4138-a64c-54abb730eeb0 is going to be updated. [ 901.426987] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.427245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.427245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.427459] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.427613] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.427797] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90abd376-d77a-4138-a64c-54abb730eeb0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.903929] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30dd50aa-556a-4adf-a58a-c76defad2778',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.409144] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.409144] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.409144] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.409144] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.409144] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.409144] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30dd50aa-556a-4adf-a58a-c76defad2778 is going to be created. [ 902.452975] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.452975] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.452975] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.452975] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.452975] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.465456] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30dd50aa-556a-4adf-a58a-c76defad2778 in Status: UNINITIALIZED for 2s [ 904.477927] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30dd50aa-556a-4adf-a58a-c76defad2778 in Status: SUCCESS [ 904.478240] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.478358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.478615] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.478826] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.478965] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.479047] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.479285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.479396] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.479683] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.479683] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30dd50aa-556a-4adf-a58a-c76defad2778',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.985462] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-30dd50aa-556a-4adf-a58a-c76defad2778 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.985650] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.985691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.985929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.986116] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.986349] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.986349] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.986467] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.986567] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.986640] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.986799] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-30dd50aa-556a-4adf-a58a-c76defad2778 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.986877] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.986924] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.987078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.987235] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.987310] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.987345] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.988252] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.988390] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.988936] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.989093] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30dd50aa-556a-4adf-a58a-c76defad2778',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.492825] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30dd50aa-556a-4adf-a58a-c76defad2778: rpc.has_security_group_logging(os_id): False [ 905.512271] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.512476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.512570] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.513058] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.513058] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.513257] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.513405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.513475] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.513669] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.513786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.514063] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.514205] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.514289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.514586] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.514657] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.514806] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.514943] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.515312] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.515312] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.515312] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.515503] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30dd50aa-556a-4adf-a58a-c76defad2778 is going to be created. [ 905.586337] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.586337] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.586337] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.586337] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.586628] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.597020] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30dd50aa-556a-4adf-a58a-c76defad2778 in Status: IN_PROGRESS for 2s [ 905.789845] env[66994]: INFO networking_nsxv3.common.synchronization [req-0e8535b6-3732-417e-893c-03739b6e4ee5 req-57aaeced-8f17-4133-98ff-c729e7299872 tempest-ServerRescueNegativeTestJSON-420933347 tempest-ServerRescueNegativeTestJSON-420933347-project-member] Enqueued Resource ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d with Priority: HIGHEST for action security_group_members [ 905.790420] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d with Priority: HIGHEST for action security_group_members [ 905.790796] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c718081-e5df-4901-a082-56a5b8ccbf2d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.790927] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.790994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.791272] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.791431] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.791531] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.791590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.791743] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.791825] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.792572] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.150023] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.150023] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-442" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.150023] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-442" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.150023] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-442" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.150023] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.150023] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.150023] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.150023] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.150023] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.150023] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 906.150023] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 906.150023] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 906.150744] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 906.150744] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 906.150744] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 906.150744] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 906.172800] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 906.172800] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 906.172800] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 906.172800] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-442" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.172800] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-603097c7-8e12-40f4-af39-d0070878f2af taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.172800] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-603097c7-8e12-40f4-af39-d0070878f2af" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.172800] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-603097c7-8e12-40f4-af39-d0070878f2af" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.172800] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-603097c7-8e12-40f4-af39-d0070878f2af" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.172800] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('603097c7-8e12-40f4-af39-d0070878f2af',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.295317] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.295474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.295536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.295751] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.295840] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.296060] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.296170] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.296230] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.296382] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.296454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.296538] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d already deleted. [ 906.296617] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.674962] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.675422] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.675422] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.675669] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.675810] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.675963] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 603097c7-8e12-40f4-af39-d0070878f2af not found, creating... [ 906.676256] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.676493] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.676554] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.676857] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.676928] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.677162] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.677351] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.677472] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.677678] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.677809] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.677946] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 603097c7-8e12-40f4-af39-d0070878f2af is going to be created. [ 906.700027] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.700245] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.700370] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.700680] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.700914] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.701155] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-603097c7-8e12-40f4-af39-d0070878f2af" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.042975] env[66994]: INFO networking_nsxv3.common.synchronization [None req-c9501636-dc08-4284-a4d2-e45d6940019b None None] Enqueued Resource ID: 53bd419b-fbe5-4776-95cc-c4fe75015218 with Priority: HIGHEST for action port [ 907.043577] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53bd419b-fbe5-4776-95cc-c4fe75015218 with Priority: HIGHEST for action port [ 907.043894] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-53bd419b-fbe5-4776-95cc-c4fe75015218 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.044247] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53bd419b-fbe5-4776-95cc-c4fe75015218" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.044247] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53bd419b-fbe5-4776-95cc-c4fe75015218" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.044426] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53bd419b-fbe5-4776-95cc-c4fe75015218" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.044426] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53bd419b-fbe5-4776-95cc-c4fe75015218',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.391703] env[66994]: INFO networking_nsxv3.common.synchronization [req-0e8535b6-3732-417e-893c-03739b6e4ee5 req-4275f152-d409-4927-b28d-4d748e6bfa2a service nova] Enqueued Resource ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d with Priority: HIGHEST for action security_group_rules [ 907.391902] env[66994]: INFO networking_nsxv3.common.synchronization [req-0e8535b6-3732-417e-893c-03739b6e4ee5 req-4275f152-d409-4927-b28d-4d748e6bfa2a service nova] Enqueued Resource ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d with Priority: HIGHEST for action security_group_members [ 907.392057] env[66994]: INFO networking_nsxv3.common.synchronization [req-0e8535b6-3732-417e-893c-03739b6e4ee5 req-4275f152-d409-4927-b28d-4d748e6bfa2a service nova] Enqueued Resource ID: 603097c7-8e12-40f4-af39-d0070878f2af with Priority: HIGHEST for action port [ 907.392564] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d with Priority: HIGHEST for action security_group_rules [ 907.392700] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d with Priority: HIGHEST for action security_group_members [ 907.392828] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 603097c7-8e12-40f4-af39-d0070878f2af with Priority: HIGHEST for action port [ 907.395540] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c718081-e5df-4901-a082-56a5b8ccbf2d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.395540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.395540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.396060] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.396183] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.397611] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c718081-e5df-4901-a082-56a5b8ccbf2d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.397743] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.397814] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.398013] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.398191] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.398289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.398366] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.398515] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.398610] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.398702] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.399540] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-603097c7-8e12-40f4-af39-d0070878f2af taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.399649] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-603097c7-8e12-40f4-af39-d0070878f2af" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.399716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-603097c7-8e12-40f4-af39-d0070878f2af" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.399864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-603097c7-8e12-40f4-af39-d0070878f2af" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.399938] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('603097c7-8e12-40f4-af39-d0070878f2af',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.546964] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53bd419b-fbe5-4776-95cc-c4fe75015218 [ 907.547257] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.547410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.547489] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.547710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.547829] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.547995] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53bd419b-fbe5-4776-95cc-c4fe75015218 already deleted. [ 907.547995] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53bd419b-fbe5-4776-95cc-c4fe75015218" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.612392] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30dd50aa-556a-4adf-a58a-c76defad2778 in Status: SUCCESS [ 907.612661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.902170] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c718081-e5df-4901-a082-56a5b8ccbf2d taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.902469] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.902609] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.903526] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 603097c7-8e12-40f4-af39-d0070878f2af with status ACTIVE [ 907.903714] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.903825] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.903891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.904106] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.904195] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.904360] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.904451] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.904513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.904661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.904733] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.904904] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.906721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.906721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.906721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.906721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.906721] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 603097c7-8e12-40f4-af39-d0070878f2af is going to be updated. [ 907.927211] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.927405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.927461] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.927658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.928256] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.928256] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-603097c7-8e12-40f4-af39-d0070878f2af" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.948314] env[66994]: INFO networking_nsxv3.common.synchronization [None req-5e9125d7-b9c5-49db-9f5e-2b30c4ee223c tempest-ServersTestFqdnHostnames-1753183055 tempest-ServersTestFqdnHostnames-1753183055-project-member] Enqueued Resource ID: c0f823fa-9f2d-40f7-9630-8dee9229983a with Priority: HIGHEST for action security_group_rules [ 907.948314] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f823fa-9f2d-40f7-9630-8dee9229983a with Priority: HIGHEST for action security_group_rules [ 907.948749] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0f823fa-9f2d-40f7-9630-8dee9229983a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.949118] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.949351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.950110] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.950371] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0f823fa-9f2d-40f7-9630-8dee9229983a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.063321] env[66994]: INFO networking_nsxv3.common.synchronization [None req-d4ef67ea-b683-4204-90a4-53745083115c tempest-ServersTestFqdnHostnames-1753183055 tempest-ServersTestFqdnHostnames-1753183055-project-member] Enqueued Resource ID: c0f823fa-9f2d-40f7-9630-8dee9229983a with Priority: HIGHEST for action security_group_rules [ 908.063997] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f823fa-9f2d-40f7-9630-8dee9229983a with Priority: HIGHEST for action security_group_rules [ 908.064733] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0f823fa-9f2d-40f7-9630-8dee9229983a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.065857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.331780] env[66994]: INFO networking_nsxv3.common.synchronization [req-95df9d8f-b2e1-433d-8704-f182ddd0c166 req-ef790bd6-979c-44a8-9376-d5b7a6f33af9 tempest-ServerRescueNegativeTestJSON-420933347 tempest-ServerRescueNegativeTestJSON-420933347-project-member] Enqueued Resource ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d with Priority: HIGHEST for action security_group_members [ 908.332352] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d with Priority: HIGHEST for action security_group_members [ 908.332654] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c718081-e5df-4901-a082-56a5b8ccbf2d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.333033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.408341] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.477693] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.477944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.478065] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.478499] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.478656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.479886] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0f823fa-9f2d-40f7-9630-8dee9229983a already deleted. [ 908.479886] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.479886] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.479886] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.479886] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0f823fa-9f2d-40f7-9630-8dee9229983a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.757530] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.757721] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-442" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.757878] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-442" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.758213] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-442" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.758495] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.758645] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.758754] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.758974] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.759351] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.760219] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 908.760219] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 908.760219] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 908.760219] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 908.760219] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 908.760219] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 908.760436] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 908.784358] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 908.785026] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 908.785026] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 908.785026] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-442" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.785255] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-aa089970-afa9-43ad-8ff5-4cc91e1df1db taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.785446] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-aa089970-afa9-43ad-8ff5-4cc91e1df1db" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.785561] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-aa089970-afa9-43ad-8ff5-4cc91e1df1db" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.785904] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-aa089970-afa9-43ad-8ff5-4cc91e1df1db" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.786364] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa089970-afa9-43ad-8ff5-4cc91e1df1db',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.911417] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.911789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.911789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.911867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.911899] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.912011] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d is going to be created. [ 908.937168] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.937375] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.937375] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.937571] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.938142] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.948420] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d in Status: UNINITIALIZED for 2s [ 909.001460] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.001610] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.001682] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.001896] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.001988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.002200] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0f823fa-9f2d-40f7-9630-8dee9229983a already deleted. [ 909.006222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.289241] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.289487] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.289613] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.289905] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.290069] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.290230] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port aa089970-afa9-43ad-8ff5-4cc91e1df1db not found, creating... [ 909.290506] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.290676] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.290792] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.291151] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.291151] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.291424] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.292061] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.292061] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.292061] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.292061] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.292473] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: aa089970-afa9-43ad-8ff5-4cc91e1df1db is going to be created. [ 909.321055] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.321249] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.322334] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.322334] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.322334] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.322334] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-aa089970-afa9-43ad-8ff5-4cc91e1df1db" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.766205] env[66994]: INFO networking_nsxv3.common.synchronization [None req-b8321ede-7019-42c9-8e78-70931e064c45 None None] Enqueued Resource ID: 7188a0c3-069c-4e21-b6c1-20c70624982f with Priority: HIGHEST for action port [ 909.766587] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7188a0c3-069c-4e21-b6c1-20c70624982f with Priority: HIGHEST for action port [ 909.766897] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-7188a0c3-069c-4e21-b6c1-20c70624982f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.767176] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7188a0c3-069c-4e21-b6c1-20c70624982f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.767262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7188a0c3-069c-4e21-b6c1-20c70624982f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.767594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7188a0c3-069c-4e21-b6c1-20c70624982f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.767676] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7188a0c3-069c-4e21-b6c1-20c70624982f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.060781] env[66994]: INFO networking_nsxv3.common.synchronization [req-95df9d8f-b2e1-433d-8704-f182ddd0c166 req-095dc8c0-0a22-40b8-ba77-48d22f7ac899 service nova] Enqueued Resource ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d with Priority: HIGHEST for action security_group_rules [ 910.060781] env[66994]: INFO networking_nsxv3.common.synchronization [req-95df9d8f-b2e1-433d-8704-f182ddd0c166 req-095dc8c0-0a22-40b8-ba77-48d22f7ac899 service nova] Enqueued Resource ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d with Priority: HIGHEST for action security_group_members [ 910.060781] env[66994]: INFO networking_nsxv3.common.synchronization [req-95df9d8f-b2e1-433d-8704-f182ddd0c166 req-095dc8c0-0a22-40b8-ba77-48d22f7ac899 service nova] Enqueued Resource ID: aa089970-afa9-43ad-8ff5-4cc91e1df1db with Priority: HIGHEST for action port [ 910.061290] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d with Priority: HIGHEST for action security_group_rules [ 910.061290] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d with Priority: HIGHEST for action security_group_members [ 910.061290] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa089970-afa9-43ad-8ff5-4cc91e1df1db with Priority: HIGHEST for action port [ 910.061581] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c718081-e5df-4901-a082-56a5b8ccbf2d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.061666] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.061937] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c718081-e5df-4901-a082-56a5b8ccbf2d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.061997] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.062253] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa089970-afa9-43ad-8ff5-4cc91e1df1db taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.062362] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa089970-afa9-43ad-8ff5-4cc91e1df1db" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.062425] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa089970-afa9-43ad-8ff5-4cc91e1df1db" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.062634] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa089970-afa9-43ad-8ff5-4cc91e1df1db" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.062731] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa089970-afa9-43ad-8ff5-4cc91e1df1db',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.271786] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7188a0c3-069c-4e21-b6c1-20c70624982f [ 910.271990] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.272072] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.272188] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.272393] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.272527] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.272657] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7188a0c3-069c-4e21-b6c1-20c70624982f already deleted. [ 910.272768] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7188a0c3-069c-4e21-b6c1-20c70624982f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.566341] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa089970-afa9-43ad-8ff5-4cc91e1df1db with status ACTIVE [ 910.566341] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.566341] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.566948] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.567244] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.567360] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.567569] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.567677] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.567739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.567976] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.568103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.568307] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.568413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.568495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.568665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.568744] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.568846] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa089970-afa9-43ad-8ff5-4cc91e1df1db is going to be updated. [ 910.594492] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.594492] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.594492] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.594492] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.594492] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.595304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa089970-afa9-43ad-8ff5-4cc91e1df1db" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.959331] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d in Status: SUCCESS [ 910.959541] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.959744] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.959970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.960247] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.960351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.960402] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.960561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.960636] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.960725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.960825] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.961935] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.961935] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.962050] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.962176] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.962255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.962376] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.962450] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.962537] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.465237] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c718081-e5df-4901-a082-56a5b8ccbf2d taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.467224] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.467224] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.969510] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.088025] env[66994]: INFO networking_nsxv3.common.synchronization [req-0199ebfc-bde7-4fc3-b947-5503b3b5c9b1 req-80e605fa-b44b-4a03-9107-0654e96c13ae tempest-ServersNegativeTestMultiTenantJSON-1862468065 tempest-ServersNegativeTestMultiTenantJSON-1862468065-project-member] Enqueued Resource ID: 30dd50aa-556a-4adf-a58a-c76defad2778 with Priority: HIGHEST for action security_group_members [ 912.088025] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30dd50aa-556a-4adf-a58a-c76defad2778 with Priority: HIGHEST for action security_group_members [ 912.088651] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-30dd50aa-556a-4adf-a58a-c76defad2778 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.089015] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.089399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.089765] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.090132] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.090381] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.092026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.092026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.092026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.092026] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30dd50aa-556a-4adf-a58a-c76defad2778',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.471169] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.471169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.475540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.475540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.475540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.475540] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d is going to be updated. [ 912.507442] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.507810] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.507888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.508144] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.508297] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.517791] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d in Status: IN_PROGRESS for 2s [ 912.594729] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.595288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.595288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.595288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.595428] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.595546] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.595668] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.595732] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.595895] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.596330] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.596330] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30dd50aa-556a-4adf-a58a-c76defad2778 is going to be updated. [ 912.630030] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.630030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.630030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.630030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.630030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.643263] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30dd50aa-556a-4adf-a58a-c76defad2778 in Status: IN_PROGRESS for 2s [ 912.894131] env[66994]: INFO networking_nsxv3.common.synchronization [None req-01096e3c-dc9d-4437-91ac-f85fed54b4c8 None None] Enqueued Resource ID: e31f63ec-7038-4efc-b62f-0e0460f0f418 with Priority: HIGHEST for action port [ 912.894652] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31f63ec-7038-4efc-b62f-0e0460f0f418 with Priority: HIGHEST for action port [ 912.894984] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-e31f63ec-7038-4efc-b62f-0e0460f0f418 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.895201] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e31f63ec-7038-4efc-b62f-0e0460f0f418" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.895248] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e31f63ec-7038-4efc-b62f-0e0460f0f418" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.895595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e31f63ec-7038-4efc-b62f-0e0460f0f418" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.895732] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e31f63ec-7038-4efc-b62f-0e0460f0f418',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.400197] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e31f63ec-7038-4efc-b62f-0e0460f0f418 [ 913.400453] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.400585] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.400653] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.400889] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.401062] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.401222] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e31f63ec-7038-4efc-b62f-0e0460f0f418 already deleted. [ 913.401326] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e31f63ec-7038-4efc-b62f-0e0460f0f418" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.482203] env[66994]: INFO networking_nsxv3.common.synchronization [None req-02e115d4-9c4d-47a0-872a-b6a334e3e882 tempest-ServerActionsTestOtherA-355769928 tempest-ServerActionsTestOtherA-355769928-project-member] Enqueued Resource ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 with Priority: HIGHEST for action security_group_rules [ 913.483043] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 with Priority: HIGHEST for action security_group_rules [ 913.483088] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.483279] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.483355] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.483626] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.483721] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.572728] env[66994]: INFO networking_nsxv3.common.synchronization [None req-57657470-efe0-415c-9c3f-21f2353555de tempest-ServerActionsTestOtherA-355769928 tempest-ServerActionsTestOtherA-355769928-project-member] Enqueued Resource ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 with Priority: HIGHEST for action security_group_rules [ 913.572728] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 with Priority: HIGHEST for action security_group_rules [ 913.573074] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.573074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.006302] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.006467] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.006530] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.006803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.006883] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.006982] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 already deleted. [ 914.007100] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.007611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.007832] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.007931] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.534020] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.534020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.534020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.534020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.534020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.534020] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 already deleted. [ 914.534020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.543774] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d in Status: SUCCESS [ 914.545830] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.545830] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.545830] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.545830] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.545830] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.545830] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.545830] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.545830] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.545830] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.652687] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30dd50aa-556a-4adf-a58a-c76defad2778 in Status: SUCCESS [ 914.653123] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30dd50aa-556a-4adf-a58a-c76defad2778 deletion is rescheduled due to dependency. [ 914.653260] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.007837] env[66994]: INFO networking_nsxv3.common.synchronization [None req-82b9a4ad-4f39-41e3-9e6d-a84ef1d40b61 None None] Enqueued Resource ID: 9bb82218-e760-4d4a-b2d9-385f0dc619f3 with Priority: HIGHEST for action port [ 915.008112] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bb82218-e760-4d4a-b2d9-385f0dc619f3 with Priority: HIGHEST for action port [ 915.008653] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bb82218-e760-4d4a-b2d9-385f0dc619f3 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.008816] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bb82218-e760-4d4a-b2d9-385f0dc619f3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.008876] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bb82218-e760-4d4a-b2d9-385f0dc619f3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.009521] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bb82218-e760-4d4a-b2d9-385f0dc619f3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.009629] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bb82218-e760-4d4a-b2d9-385f0dc619f3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.048387] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.511778] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9bb82218-e760-4d4a-b2d9-385f0dc619f3 [ 915.512017] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.512173] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.512245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.512455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.512543] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.512638] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9bb82218-e760-4d4a-b2d9-385f0dc619f3 already deleted. [ 915.512719] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bb82218-e760-4d4a-b2d9-385f0dc619f3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.550773] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.053051] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.053246] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.053292] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.054022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.054022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.054022] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d is going to be updated. [ 916.087323] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.087509] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.087561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.087761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.087904] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.097159] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d in Status: IN_PROGRESS for 2s [ 918.110775] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d in Status: SUCCESS [ 918.110775] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.111162] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.111162] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.111382] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.111507] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.111616] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.111716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.111791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.111878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.112060] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c718081-e5df-4901-a082-56a5b8ccbf2d taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.112234] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.112296] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.112445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.112590] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.112731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.112731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.112874] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.112976] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.113081] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.113189] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.616355] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c718081-e5df-4901-a082-56a5b8ccbf2d: rpc.has_security_group_logging(os_id): False [ 918.634700] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.634844] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.634932] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.635210] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.635338] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.635646] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.635795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.635889] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.636165] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.636253] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.636506] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.636645] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.636738] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.636940] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.637075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.637324] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.637456] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.637569] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.637781] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.637883] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.637996] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d is going to be created. [ 918.697305] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.697305] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.697305] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.697544] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.698402] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.709452] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d in Status: IN_PROGRESS for 2s [ 920.009394] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 920.009667] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 920.723085] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d in Status: SUCCESS [ 920.723288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.723467] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.723680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.723771] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.227751] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c718081-e5df-4901-a082-56a5b8ccbf2d taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.227751] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.227751] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.227751] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.227751] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.228579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.228579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.228579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.228579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.228579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.228579] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.730744] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c718081-e5df-4901-a082-56a5b8ccbf2d taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.730933] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.730979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.731224] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.731508] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.731618] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.731684] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.731844] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.731933] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.732040] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.732186] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c718081-e5df-4901-a082-56a5b8ccbf2d taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.732286] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.732348] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.732493] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.732632] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.732723] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.732781] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.732917] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.732992] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.733088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.733183] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.994432] env[66994]: INFO networking_nsxv3.common.synchronization [req-ae9d09bb-095b-46e1-8940-2290c6096c01 req-185b7c42-75b4-4af2-b928-5a5fc08a0c6b tempest-ServerAddressesNegativeTestJSON-731338038 tempest-ServerAddressesNegativeTestJSON-731338038-project-member] Enqueued Resource ID: 01dce4c1-af3a-4e00-a26c-16f52625131a with Priority: HIGHEST for action security_group_members [ 921.994962] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01dce4c1-af3a-4e00-a26c-16f52625131a with Priority: HIGHEST for action security_group_members [ 921.995305] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-01dce4c1-af3a-4e00-a26c-16f52625131a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.995429] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.995489] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.995743] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.995901] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.996066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.996153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.996355] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.996454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.996552] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01dce4c1-af3a-4e00-a26c-16f52625131a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.236662] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c718081-e5df-4901-a082-56a5b8ccbf2d: rpc.has_security_group_logging(os_id): False [ 922.256318] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.256485] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.256556] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.256761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.256925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.257672] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.257672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.257672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.257672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.257672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.257672] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.257972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.257972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.257972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.258105] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.258194] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.258285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.258342] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.259491] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.259491] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.259491] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d is going to be updated. [ 922.309718] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-720 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.309953] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-720" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.310268] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-720" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.310622] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-720" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.310885] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.311124] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.311187] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.311392] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.311535] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.311741] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 922.311855] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 922.311980] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 922.312078] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 922.312189] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 922.312297] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 922.312430] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 922.324051] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.324232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.324278] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.324466] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.324613] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.331481] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 922.331723] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 922.331784] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 922.331949] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-720" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.332318] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-0cb69441-03fb-4405-815d-8b9a25cef05c taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.332498] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-0cb69441-03fb-4405-815d-8b9a25cef05c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.332643] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-0cb69441-03fb-4405-815d-8b9a25cef05c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.332923] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-0cb69441-03fb-4405-815d-8b9a25cef05c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.333078] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cb69441-03fb-4405-815d-8b9a25cef05c',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.341329] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d in Status: IN_PROGRESS for 2s [ 922.498772] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.498941] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.499028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.499257] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.499351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.499559] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.499661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.499723] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.499874] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.499948] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.500045] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01dce4c1-af3a-4e00-a26c-16f52625131a already deleted. [ 922.500133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.836539] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.836770] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.836904] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.837344] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.837454] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.837561] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 0cb69441-03fb-4405-815d-8b9a25cef05c not found, creating... [ 922.837827] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.837983] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.838116] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.838358] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.838510] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.838791] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.838947] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.839077] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.839309] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.839429] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.839567] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 0cb69441-03fb-4405-815d-8b9a25cef05c is going to be created. [ 922.862967] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.863230] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.863315] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.863704] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.863948] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.864201] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-0cb69441-03fb-4405-815d-8b9a25cef05c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.578361] env[66994]: INFO networking_nsxv3.common.synchronization [req-ae9d09bb-095b-46e1-8940-2290c6096c01 req-aaae5a19-d341-4856-b272-7b436316c205 service nova] Enqueued Resource ID: 01dce4c1-af3a-4e00-a26c-16f52625131a with Priority: HIGHEST for action security_group_rules [ 923.578693] env[66994]: INFO networking_nsxv3.common.synchronization [req-ae9d09bb-095b-46e1-8940-2290c6096c01 req-aaae5a19-d341-4856-b272-7b436316c205 service nova] Enqueued Resource ID: 01dce4c1-af3a-4e00-a26c-16f52625131a with Priority: HIGHEST for action security_group_members [ 923.578693] env[66994]: INFO networking_nsxv3.common.synchronization [req-ae9d09bb-095b-46e1-8940-2290c6096c01 req-aaae5a19-d341-4856-b272-7b436316c205 service nova] Enqueued Resource ID: 0cb69441-03fb-4405-815d-8b9a25cef05c with Priority: HIGHEST for action port [ 923.579052] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01dce4c1-af3a-4e00-a26c-16f52625131a with Priority: HIGHEST for action security_group_rules [ 923.579202] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01dce4c1-af3a-4e00-a26c-16f52625131a with Priority: HIGHEST for action security_group_members [ 923.579286] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cb69441-03fb-4405-815d-8b9a25cef05c with Priority: HIGHEST for action port [ 923.579559] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01dce4c1-af3a-4e00-a26c-16f52625131a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.579680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.579745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.579998] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.580091] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01dce4c1-af3a-4e00-a26c-16f52625131a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.580931] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-01dce4c1-af3a-4e00-a26c-16f52625131a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.581073] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.581146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.581313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.581459] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.581574] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.581637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.581778] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.581859] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.581946] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01dce4c1-af3a-4e00-a26c-16f52625131a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.582716] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-0cb69441-03fb-4405-815d-8b9a25cef05c taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.582840] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0cb69441-03fb-4405-815d-8b9a25cef05c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.582930] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0cb69441-03fb-4405-815d-8b9a25cef05c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.583126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0cb69441-03fb-4405-815d-8b9a25cef05c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.583385] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cb69441-03fb-4405-815d-8b9a25cef05c',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.088922] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-01dce4c1-af3a-4e00-a26c-16f52625131a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.089092] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.089299] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01dce4c1-af3a-4e00-a26c-16f52625131a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.090772] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0cb69441-03fb-4405-815d-8b9a25cef05c with status ACTIVE [ 924.090772] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.091279] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.091279] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.091279] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.091279] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.091548] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.091629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.091629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.092754] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.093154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.093154] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.093405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.093479] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.093737] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.094122] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.094122] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0cb69441-03fb-4405-815d-8b9a25cef05c is going to be updated. [ 924.120354] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.120503] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.120581] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.120794] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.120929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.121106] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0cb69441-03fb-4405-815d-8b9a25cef05c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.355345] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d in Status: SUCCESS [ 924.355680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.544774] env[66994]: INFO networking_nsxv3.common.synchronization [req-7d555237-5c34-4f74-8e20-9374b5927dcd req-fc58fdb8-bec6-46c5-adca-3fdc3171d651 tempest-ServerDiskConfigTestJSON-2121377508 tempest-ServerDiskConfigTestJSON-2121377508-project-member] Enqueued Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 924.545398] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 924.545724] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.545855] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.546036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.546306] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.546490] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.546594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.546657] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.546820] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.546906] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.547009] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.596656] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01dce4c1-af3a-4e00-a26c-16f52625131a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.925135] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-172 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.925135] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-172" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.925135] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-172" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.925135] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-172" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.925577] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.925908] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.926282] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.927836] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.927836] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.927836] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.927836] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 924.927836] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 924.927836] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 924.927836] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.927836] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 924.927836] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 924.950950] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 924.951220] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 924.951373] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 924.951544] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-172" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.951861] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-2eaf847b-b13a-47d8-9063-52fc1754a12e taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.952044] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-2eaf847b-b13a-47d8-9063-52fc1754a12e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.952165] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-2eaf847b-b13a-47d8-9063-52fc1754a12e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.952469] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-2eaf847b-b13a-47d8-9063-52fc1754a12e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.952616] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2eaf847b-b13a-47d8-9063-52fc1754a12e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.049154] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.049331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.049405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.049721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.049721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.049910] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.049987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.050059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.050219] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.050312] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.050402] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 is going to be updated. [ 925.081792] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.081792] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.081792] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.081792] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.081792] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.092299] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: IN_PROGRESS for 2s [ 925.098897] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.099159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.099159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.099345] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.099438] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.099536] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01dce4c1-af3a-4e00-a26c-16f52625131a is going to be created. [ 925.123255] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.123255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.123431] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.123558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.123725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.136255] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01dce4c1-af3a-4e00-a26c-16f52625131a in Status: UNINITIALIZED for 2s [ 925.454791] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.455367] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.455538] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.456038] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.456200] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.456554] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 2eaf847b-b13a-47d8-9063-52fc1754a12e not found, creating... [ 925.456713] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.456846] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.456965] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.457209] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.457330] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.457644] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.457790] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.457906] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.458131] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.458262] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.458399] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 2eaf847b-b13a-47d8-9063-52fc1754a12e is going to be created. [ 925.482708] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.483147] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.483300] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.483533] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.483824] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.484140] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-2eaf847b-b13a-47d8-9063-52fc1754a12e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.192655] env[66994]: INFO networking_nsxv3.common.synchronization [req-7d555237-5c34-4f74-8e20-9374b5927dcd req-c9bfbe3d-3511-482d-a637-10853db9701e service nova] Enqueued Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_rules [ 926.192988] env[66994]: INFO networking_nsxv3.common.synchronization [req-7d555237-5c34-4f74-8e20-9374b5927dcd req-c9bfbe3d-3511-482d-a637-10853db9701e service nova] Enqueued Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 926.193070] env[66994]: INFO networking_nsxv3.common.synchronization [req-7d555237-5c34-4f74-8e20-9374b5927dcd req-c9bfbe3d-3511-482d-a637-10853db9701e service nova] Enqueued Resource ID: 2eaf847b-b13a-47d8-9063-52fc1754a12e with Priority: HIGHEST for action port [ 926.193806] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_rules [ 926.193806] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 926.193806] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eaf847b-b13a-47d8-9063-52fc1754a12e with Priority: HIGHEST for action port [ 926.194555] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.194555] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.194733] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.196740] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.196834] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.197867] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.197970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.198185] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-2eaf847b-b13a-47d8-9063-52fc1754a12e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.198285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2eaf847b-b13a-47d8-9063-52fc1754a12e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.198384] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2eaf847b-b13a-47d8-9063-52fc1754a12e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.198527] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2eaf847b-b13a-47d8-9063-52fc1754a12e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.198597] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2eaf847b-b13a-47d8-9063-52fc1754a12e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.700171] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.700309] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.701589] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2eaf847b-b13a-47d8-9063-52fc1754a12e with status ACTIVE [ 926.701761] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.701870] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.702021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.702241] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.702331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.702531] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.702602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.702662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.702903] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.702993] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.703186] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.703277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.703339] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.703475] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.703546] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.703631] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2eaf847b-b13a-47d8-9063-52fc1754a12e is going to be updated. [ 926.725727] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.725875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.725965] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.726138] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.726288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.726440] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2eaf847b-b13a-47d8-9063-52fc1754a12e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.089696] env[66994]: INFO networking_nsxv3.common.synchronization [req-409dd424-bf99-437d-817f-268e2a411286 req-ad235200-eb3a-400b-9763-d5f622ca9d21 tempest-ServerRescueTestJSONUnderV235-453137144 tempest-ServerRescueTestJSONUnderV235-453137144-project-member] Enqueued Resource ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 with Priority: HIGHEST for action security_group_members [ 927.091856] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 with Priority: HIGHEST for action security_group_members [ 927.091856] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-f732d92a-92e7-4f0e-8801-62a1e2b456e4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.091856] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.092187] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.092555] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.097147] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.097147] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.097147] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.097147] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.097147] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.097147] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.107698] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: SUCCESS [ 927.107698] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 deletion is rescheduled due to dependency. [ 927.107698] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.107698] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.107698] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.107853] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.108043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.108043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.108195] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.108276] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.108373] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.146168] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01dce4c1-af3a-4e00-a26c-16f52625131a in Status: SUCCESS [ 927.146454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.146658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.146870] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.147073] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.147197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.147263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.147414] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.147493] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.147574] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.147661] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01dce4c1-af3a-4e00-a26c-16f52625131a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.431507] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-256 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.431880] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-256" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.431880] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-256" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.432163] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-256" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.432429] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.432581] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.432694] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.432908] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.434027] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.434027] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 927.434027] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 927.434027] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 927.434027] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 927.434027] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 927.434027] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 927.434506] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 927.457422] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 927.457582] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 927.457749] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 927.457984] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-256" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.458328] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-7299cc3c-d2b5-4558-baff-e263c7dfe173 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.458507] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-7299cc3c-d2b5-4558-baff-e263c7dfe173" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.458626] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-7299cc3c-d2b5-4558-baff-e263c7dfe173" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.458945] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-7299cc3c-d2b5-4558-baff-e263c7dfe173" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.460055] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7299cc3c-d2b5-4558-baff-e263c7dfe173',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.601128] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.601128] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.601128] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.601128] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.601128] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.601356] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.601418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.602151] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.602151] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.602151] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.602151] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 already deleted. [ 927.602151] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.610705] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.650320] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-01dce4c1-af3a-4e00-a26c-16f52625131a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.650521] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.650606] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.650929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.651197] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.651327] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.651406] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.651643] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.651806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.651909] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.652143] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-01dce4c1-af3a-4e00-a26c-16f52625131a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.652306] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.652420] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.652574] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.652720] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.652836] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.652935] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.653331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.653512] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.653560] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.653708] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01dce4c1-af3a-4e00-a26c-16f52625131a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.961837] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.962166] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.962304] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.962626] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.962813] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.962979] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 7299cc3c-d2b5-4558-baff-e263c7dfe173 not found, creating... [ 927.963285] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.963438] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.963553] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.963783] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.963922] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.964306] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.964482] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.964601] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.964813] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.964945] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.965193] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 7299cc3c-d2b5-4558-baff-e263c7dfe173 is going to be created. [ 927.987503] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.987823] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.987956] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.989065] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.989065] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.989065] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-7299cc3c-d2b5-4558-baff-e263c7dfe173" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.114072] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.156130] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01dce4c1-af3a-4e00-a26c-16f52625131a: rpc.has_security_group_logging(os_id): False [ 928.179064] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.179310] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.179310] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.179537] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.179634] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.179868] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.179984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.180064] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.180247] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.180355] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.180557] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.180643] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.180699] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.180844] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.180908] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.181113] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.181219] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.181273] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.181396] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.181464] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.181723] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01dce4c1-af3a-4e00-a26c-16f52625131a is going to be created. [ 928.251152] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.251339] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.251438] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.251607] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.251789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.265403] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01dce4c1-af3a-4e00-a26c-16f52625131a in Status: IN_PROGRESS for 2s [ 928.616593] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.616899] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.616899] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.617043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.617137] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.617239] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 is going to be updated. [ 928.652857] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.652857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.652857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.652857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.652857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.663367] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: IN_PROGRESS for 2s [ 928.723488] env[66994]: INFO networking_nsxv3.common.synchronization [req-409dd424-bf99-437d-817f-268e2a411286 req-47f6f561-5b7c-41bd-92f8-e5d03e8c2373 service nova] Enqueued Resource ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 with Priority: HIGHEST for action security_group_rules [ 928.723666] env[66994]: INFO networking_nsxv3.common.synchronization [req-409dd424-bf99-437d-817f-268e2a411286 req-47f6f561-5b7c-41bd-92f8-e5d03e8c2373 service nova] Enqueued Resource ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 with Priority: HIGHEST for action security_group_members [ 928.723874] env[66994]: INFO networking_nsxv3.common.synchronization [req-409dd424-bf99-437d-817f-268e2a411286 req-47f6f561-5b7c-41bd-92f8-e5d03e8c2373 service nova] Enqueued Resource ID: 7299cc3c-d2b5-4558-baff-e263c7dfe173 with Priority: HIGHEST for action port [ 928.724484] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 with Priority: HIGHEST for action security_group_rules [ 928.724699] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 with Priority: HIGHEST for action security_group_members [ 928.724839] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7299cc3c-d2b5-4558-baff-e263c7dfe173 with Priority: HIGHEST for action port [ 928.725198] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f732d92a-92e7-4f0e-8801-62a1e2b456e4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.725369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.725432] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.725688] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.725767] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.726635] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-f732d92a-92e7-4f0e-8801-62a1e2b456e4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.726744] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.726801] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.726988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.727152] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.727248] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.727295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.727423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.727510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.727686] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.728865] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-7299cc3c-d2b5-4558-baff-e263c7dfe173 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.729206] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7299cc3c-d2b5-4558-baff-e263c7dfe173" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.729206] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7299cc3c-d2b5-4558-baff-e263c7dfe173" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.729294] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7299cc3c-d2b5-4558-baff-e263c7dfe173" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.729556] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7299cc3c-d2b5-4558-baff-e263c7dfe173',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.230908] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-f732d92a-92e7-4f0e-8801-62a1e2b456e4 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.231079] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.231260] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.232203] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7299cc3c-d2b5-4558-baff-e263c7dfe173 with status ACTIVE [ 929.232417] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.232535] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.232623] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.232789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.232876] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.233066] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.233160] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.233227] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.233403] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.233478] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.233656] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.233744] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.233806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.233936] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.234024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.234353] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7299cc3c-d2b5-4558-baff-e263c7dfe173 is going to be updated. [ 929.260116] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.260346] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.260422] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.260631] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.260781] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.260925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7299cc3c-d2b5-4558-baff-e263c7dfe173" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.735782] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.238739] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.238739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.238739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.238739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.238739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.239141] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 is going to be created. [ 930.266596] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.266803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.266857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.267085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.267245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.278292] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 in Status: UNINITIALIZED for 2s [ 930.279341] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01dce4c1-af3a-4e00-a26c-16f52625131a in Status: SUCCESS [ 930.279565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.675075] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: SUCCESS [ 930.675075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.675075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.675075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.675075] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.675518] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.675518] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.675518] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.675518] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.675518] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.675699] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.182024] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.182024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.182024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.182024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.182024] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.182024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.182024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.183056] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.183056] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.183056] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.183056] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.183056] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.183056] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.183056] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.183056] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.183525] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.183525] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.183525] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.183525] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.183525] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.183525] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.686045] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b62a4f35-964f-404b-ba36-70b4e8cb2dc5: rpc.has_security_group_logging(os_id): False [ 931.707222] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.707381] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.707480] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.707729] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.707840] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.708026] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.708128] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.708191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.708344] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.708596] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.708596] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.708768] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.708768] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.708872] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.708940] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.709151] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.709394] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.709394] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.709482] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.709482] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.709604] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 is going to be updated. [ 931.784042] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.784042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.784238] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.784512] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.784761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.802681] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: IN_PROGRESS for 2s [ 932.289564] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 in Status: SUCCESS [ 932.289945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.290225] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.290576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.290882] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.291091] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.291221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.291491] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.291674] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.291893] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.292409] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.795604] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-f732d92a-92e7-4f0e-8801-62a1e2b456e4 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.795821] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.795891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.796167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.796536] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.796536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.796640] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.796804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.796891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.797028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.797191] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-f732d92a-92e7-4f0e-8801-62a1e2b456e4 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.797300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.797360] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.797532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.797698] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.797802] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.797864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.798034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.798116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.798290] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.798384] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.301274] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f732d92a-92e7-4f0e-8801-62a1e2b456e4: rpc.has_security_group_logging(os_id): False [ 933.321255] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.321418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.321469] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.321721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.321813] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.322042] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.322168] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.322227] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.322414] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.322506] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.322680] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.322784] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.322838] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.322988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.323079] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.323314] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.323402] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.323467] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.323624] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.323697] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.323785] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 is going to be created. [ 933.443522] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.443756] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.443814] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.444012] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.444244] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.462988] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 in Status: IN_PROGRESS for 2s [ 933.726415] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 933.726415] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 933.823369] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: SUCCESS [ 933.823590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.323613] env[66994]: INFO networking_nsxv3.common.synchronization [req-e5fb7c17-a646-4c86-8903-9e8f6aea5ee9 req-db94f276-491a-40a2-8bd8-bf80cba9eb8f tempest-ServerAddressesNegativeTestJSON-731338038 tempest-ServerAddressesNegativeTestJSON-731338038-project-member] Enqueued Resource ID: 01dce4c1-af3a-4e00-a26c-16f52625131a with Priority: HIGHEST for action security_group_members [ 934.325057] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01dce4c1-af3a-4e00-a26c-16f52625131a with Priority: HIGHEST for action security_group_members [ 934.328627] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-01dce4c1-af3a-4e00-a26c-16f52625131a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.328885] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.329291] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.329291] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.329536] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.329719] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.329795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.330064] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.330236] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.330395] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01dce4c1-af3a-4e00-a26c-16f52625131a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.833732] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.833732] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.833859] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.834696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.834696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.834696] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.834696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.834696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.834696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.834696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.835104] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01dce4c1-af3a-4e00-a26c-16f52625131a is going to be updated. [ 934.864557] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.864703] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.864810] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.864973] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.865127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.874832] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01dce4c1-af3a-4e00-a26c-16f52625131a in Status: IN_PROGRESS for 2s [ 935.477205] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 in Status: SUCCESS [ 935.477586] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.891614] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01dce4c1-af3a-4e00-a26c-16f52625131a in Status: SUCCESS [ 936.891996] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01dce4c1-af3a-4e00-a26c-16f52625131a deletion is rescheduled due to dependency. [ 936.891996] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.537517] env[66994]: INFO networking_nsxv3.common.synchronization [req-aae1316a-362d-4f96-9c8c-75b9fc8dc21f req-a18bad2d-a4b0-4fd5-b56e-d4ac963bce7c tempest-ServersTestJSON-587851554 tempest-ServersTestJSON-587851554-project-member] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 937.538724] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 937.539474] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.539698] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.539698] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.540536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.540536] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.540536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.540536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.540536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.540736] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.540736] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.933668] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.935724] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.935724] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.935724] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.935724] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.935724] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.935724] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.935724] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.936123] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.936123] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.936123] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 937.936213] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 937.936810] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 937.936810] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.936810] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 937.936810] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 937.961118] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 937.961249] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 937.961392] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 937.961567] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.962018] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-3370ebf4-1693-46c6-9c59-52d884dd6502 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.962178] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-3370ebf4-1693-46c6-9c59-52d884dd6502" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.962371] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-3370ebf4-1693-46c6-9c59-52d884dd6502" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.962717] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-3370ebf4-1693-46c6-9c59-52d884dd6502" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.962855] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3370ebf4-1693-46c6-9c59-52d884dd6502',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.043031] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.466033] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.466279] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.466485] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.466887] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.467025] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.467269] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 3370ebf4-1693-46c6-9c59-52d884dd6502 not found, creating... [ 938.467648] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.467900] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.468125] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.468468] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.468700] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.470706] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.470997] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.471218] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.471599] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.471832] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.472021] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 3370ebf4-1693-46c6-9c59-52d884dd6502 is going to be created. [ 938.499778] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.500036] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.500136] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.500679] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.500852] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.501183] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-3370ebf4-1693-46c6-9c59-52d884dd6502" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.546470] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.049288] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.049634] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.049634] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.049870] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.049951] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.050063] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 939.083183] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.083423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.083649] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.083912] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.083990] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.102070] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 939.217293] env[66994]: INFO networking_nsxv3.common.synchronization [req-aae1316a-362d-4f96-9c8c-75b9fc8dc21f req-a1e39354-472b-4e9e-af94-7bf35fc93b76 service nova] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_rules [ 939.217293] env[66994]: INFO networking_nsxv3.common.synchronization [req-aae1316a-362d-4f96-9c8c-75b9fc8dc21f req-a1e39354-472b-4e9e-af94-7bf35fc93b76 service nova] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 939.217293] env[66994]: INFO networking_nsxv3.common.synchronization [req-aae1316a-362d-4f96-9c8c-75b9fc8dc21f req-a1e39354-472b-4e9e-af94-7bf35fc93b76 service nova] Enqueued Resource ID: 3370ebf4-1693-46c6-9c59-52d884dd6502 with Priority: HIGHEST for action port [ 939.217693] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_rules [ 939.217983] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 939.218230] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3370ebf4-1693-46c6-9c59-52d884dd6502 with Priority: HIGHEST for action port [ 939.219283] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.220308] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.220470] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.223037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.223037] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.223037] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.223037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.223409] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-3370ebf4-1693-46c6-9c59-52d884dd6502 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.223941] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3370ebf4-1693-46c6-9c59-52d884dd6502" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.224172] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3370ebf4-1693-46c6-9c59-52d884dd6502" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.224621] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3370ebf4-1693-46c6-9c59-52d884dd6502" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.224858] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3370ebf4-1693-46c6-9c59-52d884dd6502',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.729519] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.729651] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.730030] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3370ebf4-1693-46c6-9c59-52d884dd6502 with status ACTIVE [ 939.730113] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.731625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.731625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.731625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.731625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.731625] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.731625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.731625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.731625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.731625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.731625] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.731625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.731625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.731625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.732043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.732043] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3370ebf4-1693-46c6-9c59-52d884dd6502 is going to be updated. [ 939.762022] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.762022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.762022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.762022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.762022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.762022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3370ebf4-1693-46c6-9c59-52d884dd6502" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.770155] env[66994]: INFO networking_nsxv3.common.synchronization [req-3271a632-86fa-492f-ba53-77ce8dc9b8d6 req-021eabcc-fad2-45ef-afd2-345c417c546d tempest-ServersAdminTestJSON-1722983547 tempest-ServersAdminTestJSON-1722983547-project-member] Enqueued Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 939.771057] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGHEST for action security_group_members [ 939.771057] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.772237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.772237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.772237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.772237] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.772237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.772237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.772237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.772237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.772237] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.191657] env[66994]: INFO networking_nsxv3.common.synchronization [req-3c3b4218-fb19-4642-889d-232200c219ef req-26da1ce9-4026-44c8-81e8-a4205d7e4752 tempest-ServerPasswordTestJSON-1820551532 tempest-ServerPasswordTestJSON-1820551532-project-member] Enqueued Resource ID: c4739c3c-8ad5-4540-a6bb-cc50fab810cc with Priority: HIGHEST for action security_group_members [ 940.192414] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4739c3c-8ad5-4540-a6bb-cc50fab810cc with Priority: HIGHEST for action security_group_members [ 940.193103] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.193103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.193103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.193384] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.193650] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.193876] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.193940] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.194146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.194256] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.194390] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4739c3c-8ad5-4540-a6bb-cc50fab810cc',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.274956] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.275178] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.275214] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.275536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.275695] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.275946] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.276079] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.276173] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.276382] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.276486] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.276578] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 is going to be updated. [ 940.326307] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.327863] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.327863] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.327863] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.327863] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.342780] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: IN_PROGRESS for 2s [ 940.696766] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.697032] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.697032] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.697251] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.697319] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.697527] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.697638] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.697691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.697816] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.697885] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.697971] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4739c3c-8ad5-4540-a6bb-cc50fab810cc already deleted. [ 940.698075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.700138] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-180 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.700326] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-180" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.700447] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-180" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.700723] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-180" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.700968] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.701127] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.701240] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.701440] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.701600] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.701782] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 940.701894] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 940.701997] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 940.702113] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 940.702217] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 940.702320] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 940.702445] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 940.722987] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 940.723234] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 940.723421] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 940.723621] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-180" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.723940] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-1619dbc2-4acc-4370-8e6f-53118549959c taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.724123] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-1619dbc2-4acc-4370-8e6f-53118549959c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.724246] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-1619dbc2-4acc-4370-8e6f-53118549959c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.724606] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-1619dbc2-4acc-4370-8e6f-53118549959c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.724762] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1619dbc2-4acc-4370-8e6f-53118549959c',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.118780] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 941.119036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.119216] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.119445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.119662] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.119757] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.119809] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.119972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.120071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.120209] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.227657] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.228128] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.228128] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.228425] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.228535] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.228818] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 1619dbc2-4acc-4370-8e6f-53118549959c not found, creating... [ 941.229064] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.229270] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.229419] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.229668] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.229832] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.230168] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.230322] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.230468] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.230774] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.231021] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.231122] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 1619dbc2-4acc-4370-8e6f-53118549959c is going to be created. [ 941.254147] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.254501] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.254827] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.255078] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.255417] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.255698] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-1619dbc2-4acc-4370-8e6f-53118549959c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.623009] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.986823] env[66994]: INFO networking_nsxv3.common.synchronization [req-3c3b4218-fb19-4642-889d-232200c219ef req-8d325dfd-d25b-4711-8af4-cc7ec4c49a04 service nova] Enqueued Resource ID: c4739c3c-8ad5-4540-a6bb-cc50fab810cc with Priority: HIGHEST for action security_group_rules [ 941.987017] env[66994]: INFO networking_nsxv3.common.synchronization [req-3c3b4218-fb19-4642-889d-232200c219ef req-8d325dfd-d25b-4711-8af4-cc7ec4c49a04 service nova] Enqueued Resource ID: c4739c3c-8ad5-4540-a6bb-cc50fab810cc with Priority: HIGHEST for action security_group_members [ 941.987164] env[66994]: INFO networking_nsxv3.common.synchronization [req-3c3b4218-fb19-4642-889d-232200c219ef req-8d325dfd-d25b-4711-8af4-cc7ec4c49a04 service nova] Enqueued Resource ID: 1619dbc2-4acc-4370-8e6f-53118549959c with Priority: HIGHEST for action port [ 941.987774] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4739c3c-8ad5-4540-a6bb-cc50fab810cc with Priority: HIGHEST for action security_group_rules [ 941.988542] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4739c3c-8ad5-4540-a6bb-cc50fab810cc with Priority: HIGHEST for action security_group_members [ 941.988702] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1619dbc2-4acc-4370-8e6f-53118549959c with Priority: HIGHEST for action port [ 941.989020] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4739c3c-8ad5-4540-a6bb-cc50fab810cc taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.989511] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.989511] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.989511] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.989701] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4739c3c-8ad5-4540-a6bb-cc50fab810cc',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.991176] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.993761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.993761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.993761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.993761] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.993761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.993761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.993761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.993761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.993761] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4739c3c-8ad5-4540-a6bb-cc50fab810cc',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.996256] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-1619dbc2-4acc-4370-8e6f-53118549959c taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.996368] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1619dbc2-4acc-4370-8e6f-53118549959c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.997156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1619dbc2-4acc-4370-8e6f-53118549959c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.997360] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1619dbc2-4acc-4370-8e6f-53118549959c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.998208] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1619dbc2-4acc-4370-8e6f-53118549959c',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.126801] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.353201] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 in Status: SUCCESS [ 942.353499] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 deletion is rescheduled due to dependency. [ 942.353549] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.501892] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4739c3c-8ad5-4540-a6bb-cc50fab810cc',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.503750] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.503893] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.504274] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1619dbc2-4acc-4370-8e6f-53118549959c with status ACTIVE [ 942.504718] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.504718] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.504718] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.504873] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.504956] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.505202] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.505286] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.505617] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.505617] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.505757] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.505898] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.506023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.506023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.506203] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.506662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.506662] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1619dbc2-4acc-4370-8e6f-53118549959c is going to be updated. [ 942.530244] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.530388] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.530481] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.530707] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.530809] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.530982] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1619dbc2-4acc-4370-8e6f-53118549959c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.634237] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.634464] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.634545] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.634761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.634854] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.634955] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 942.682282] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.682467] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.682535] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.682798] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.682953] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.694227] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 943.005678] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4739c3c-8ad5-4540-a6bb-cc50fab810cc',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.126954] env[66994]: INFO networking_nsxv3.common.synchronization [None req-bd41e9fb-a648-4fa5-a20e-51ca0fa2708e None None] Enqueued Resource ID: be21d162-9f43-402c-8daa-d215d9846225 with Priority: HIGHEST for action port [ 943.130516] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be21d162-9f43-402c-8daa-d215d9846225 with Priority: HIGHEST for action port [ 943.131344] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-be21d162-9f43-402c-8daa-d215d9846225 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.131466] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be21d162-9f43-402c-8daa-d215d9846225" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.131539] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be21d162-9f43-402c-8daa-d215d9846225" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.131805] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be21d162-9f43-402c-8daa-d215d9846225" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.131899] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be21d162-9f43-402c-8daa-d215d9846225',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.508475] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.508475] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.508475] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.508879] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.509627] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.509823] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4739c3c-8ad5-4540-a6bb-cc50fab810cc is going to be created. [ 943.539112] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.539112] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.539112] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.539112] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.539112] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.550770] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4739c3c-8ad5-4540-a6bb-cc50fab810cc in Status: UNINITIALIZED for 2s [ 943.635347] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be21d162-9f43-402c-8daa-d215d9846225 [ 943.637342] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.637520] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.637582] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.637938] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.637938] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.639130] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be21d162-9f43-402c-8daa-d215d9846225 already deleted. [ 943.639130] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be21d162-9f43-402c-8daa-d215d9846225" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.706996] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 944.708027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.708027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.708027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.708804] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.708804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.708804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.709103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.709202] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.709821] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.709821] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.894022] env[66994]: INFO networking_nsxv3.common.synchronization [None req-5c8d7ce7-aba2-48c3-a533-9014de16e366 tempest-ServerActionsTestJSON-501116813 tempest-ServerActionsTestJSON-501116813-project-member] Enqueued Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_rules [ 944.894022] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_rules [ 944.894022] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88a75cae-9123-4d4d-9e51-add1196ab1f2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.894022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.894022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.894954] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.895198] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.996941] env[66994]: INFO networking_nsxv3.common.synchronization [None req-41cf9a7b-a480-49a6-a442-1df5a4f51e06 tempest-ServerActionsTestJSON-501116813 tempest-ServerActionsTestJSON-501116813-project-member] Enqueued Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_rules [ 944.997516] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_rules [ 944.997822] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88a75cae-9123-4d4d-9e51-add1196ab1f2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.997927] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.213923] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.213923] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.213923] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.213923] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.214377] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.214377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.214377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.214377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.214377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.214671] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.214671] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.214795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.214852] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.215167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.215167] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.215824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.215824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.215824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.215824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.215824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.215824] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.410657] env[66994]: INFO networking_nsxv3.common.synchronization [None req-327d7da6-d638-46f1-8828-a56c7e1c2843 None None] Enqueued Resource ID: 9bc7c4a0-fc39-46a6-911b-d3ba63008edc with Priority: HIGHEST for action port [ 945.410657] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bc7c4a0-fc39-46a6-911b-d3ba63008edc with Priority: HIGHEST for action port [ 945.410657] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bc7c4a0-fc39-46a6-911b-d3ba63008edc taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.410848] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bc7c4a0-fc39-46a6-911b-d3ba63008edc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.410848] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bc7c4a0-fc39-46a6-911b-d3ba63008edc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.411910] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bc7c4a0-fc39-46a6-911b-d3ba63008edc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.411910] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bc7c4a0-fc39-46a6-911b-d3ba63008edc',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.419109] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.419109] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.419296] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.419488] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.419599] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.419726] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 already deleted. [ 945.419837] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.420454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.421264] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.421468] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.486899] env[66994]: INFO networking_nsxv3.common.synchronization [None req-99e0637c-0de3-47d3-923d-b62898ea200d tempest-ServerRescueNegativeTestJSON-420933347 tempest-ServerRescueNegativeTestJSON-420933347-project-member] Enqueued Resource ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 with Priority: HIGHEST for action security_group_rules [ 945.487455] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 with Priority: HIGHEST for action security_group_rules [ 945.488129] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e887c3d4-547e-480b-bd4c-f503fcb02ca5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.488129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.488129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.488463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.488463] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e887c3d4-547e-480b-bd4c-f503fcb02ca5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.564983] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4739c3c-8ad5-4540-a6bb-cc50fab810cc in Status: SUCCESS [ 945.566344] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.566677] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.568082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.568559] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.568869] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.569615] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.570576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.570736] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.570998] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.571177] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4739c3c-8ad5-4540-a6bb-cc50fab810cc',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.684200] env[66994]: INFO networking_nsxv3.common.synchronization [None req-a25ad898-c875-4b5d-b548-d58effd73f8c tempest-ServerRescueNegativeTestJSON-420933347 tempest-ServerRescueNegativeTestJSON-420933347-project-member] Enqueued Resource ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 with Priority: HIGHEST for action security_group_rules [ 945.684298] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 with Priority: HIGHEST for action security_group_rules [ 945.684737] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e887c3d4-547e-480b-bd4c-f503fcb02ca5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.684913] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.718728] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8: rpc.has_security_group_logging(os_id): False [ 945.739655] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.739655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.739655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.739655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.739655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.739907] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.739907] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.739990] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.740104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.740183] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.740358] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.740449] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.740513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.740714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.740915] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.741312] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.741312] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.741437] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.741592] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.741695] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.741805] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 945.830236] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.830512] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.830623] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.830962] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.831204] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.846502] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 945.914074] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9bc7c4a0-fc39-46a6-911b-d3ba63008edc [ 945.914370] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.914564] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.914950] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.915514] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.915607] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.915732] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9bc7c4a0-fc39-46a6-911b-d3ba63008edc already deleted. [ 945.915821] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bc7c4a0-fc39-46a6-911b-d3ba63008edc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.944937] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.945116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.946564] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.946564] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.946564] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.946564] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 already deleted. [ 945.946564] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.011127] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.012622] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.012622] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.012622] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.012622] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.012622] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 already deleted. [ 946.012622] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.012622] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.012622] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.012622] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e887c3d4-547e-480b-bd4c-f503fcb02ca5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.075184] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.075809] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.076974] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.079377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.079377] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.079377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.079377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.079377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.079377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.079377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.079377] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.079377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.079377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.079377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.079377] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.079377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.079377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.079377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.079377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.079377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.080275] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4739c3c-8ad5-4540-a6bb-cc50fab810cc',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.539858] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.540059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.540122] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.540851] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.540851] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.540851] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 already deleted. [ 946.540851] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.543352] env[66994]: INFO networking_nsxv3.common.synchronization [req-d23a13f6-63a5-4880-ac29-f638cf84d462 req-91a7164f-579d-40a2-9cee-b88d840d8630 tempest-ImagesTestJSON-691407333 tempest-ImagesTestJSON-691407333-project-member] Enqueued Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 946.544074] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 946.544229] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.544379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.544450] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.545061] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.545061] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.545061] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.545061] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.547314] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.547314] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.547314] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.581926] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4739c3c-8ad5-4540-a6bb-cc50fab810cc: rpc.has_security_group_logging(os_id): False [ 946.602042] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.602042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.602042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.602042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.602042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.602042] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.602042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.602042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.602630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.602630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.602689] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.603681] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.603681] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.603681] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.603681] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.603970] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.603970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.604073] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.604376] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.604445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.604542] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4739c3c-8ad5-4540-a6bb-cc50fab810cc is going to be created. [ 946.675041] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.675041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.675041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.675227] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.675255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.688960] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4739c3c-8ad5-4540-a6bb-cc50fab810cc in Status: IN_PROGRESS for 2s [ 946.931231] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-744 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.931556] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-744" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.931683] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-744" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.932232] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-744" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.932550] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.932753] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.932915] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.933216] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.933558] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.933780] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 946.934022] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 946.934185] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 946.934463] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 946.934463] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 946.934569] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 946.934643] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 946.958175] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 946.958175] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 946.958175] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 946.958175] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-744" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.958175] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-fd64de39-508a-4c6e-8891-44d146f301bd taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.958175] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-fd64de39-508a-4c6e-8891-44d146f301bd" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.958175] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-fd64de39-508a-4c6e-8891-44d146f301bd" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.958175] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-fd64de39-508a-4c6e-8891-44d146f301bd" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.958175] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd64de39-508a-4c6e-8891-44d146f301bd',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.057957] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.057957] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.057957] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.057957] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.057957] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.057957] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.057957] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.057957] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.057957] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.057957] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.057957] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e is going to be updated. [ 947.113034] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.113034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.113034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.113034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.113034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.124419] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: IN_PROGRESS for 2s [ 947.464679] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.464912] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.465057] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.465388] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.465533] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.465831] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port fd64de39-508a-4c6e-8891-44d146f301bd not found, creating... [ 947.467434] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.467434] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.467434] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.467434] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.467434] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.467434] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.467434] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.467434] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.468246] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.468246] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.468246] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: fd64de39-508a-4c6e-8891-44d146f301bd is going to be created. [ 947.494757] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.494953] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.495100] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.495421] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.495744] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.496334] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-fd64de39-508a-4c6e-8891-44d146f301bd" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.862423] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 947.862717] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.318629] env[66994]: INFO networking_nsxv3.common.synchronization [req-d23a13f6-63a5-4880-ac29-f638cf84d462 req-6abfeaae-abef-41ca-9a2c-87c4be9f90da service nova] Enqueued Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_rules [ 948.319640] env[66994]: INFO networking_nsxv3.common.synchronization [req-d23a13f6-63a5-4880-ac29-f638cf84d462 req-6abfeaae-abef-41ca-9a2c-87c4be9f90da service nova] Enqueued Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 948.319640] env[66994]: INFO networking_nsxv3.common.synchronization [req-d23a13f6-63a5-4880-ac29-f638cf84d462 req-6abfeaae-abef-41ca-9a2c-87c4be9f90da service nova] Enqueued Resource ID: fd64de39-508a-4c6e-8891-44d146f301bd with Priority: HIGHEST for action port [ 948.320181] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_rules [ 948.320349] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 948.320454] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd64de39-508a-4c6e-8891-44d146f301bd with Priority: HIGHEST for action port [ 948.320742] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.320867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.320936] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.321160] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.321246] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.322775] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.322914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.323153] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd64de39-508a-4c6e-8891-44d146f301bd taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.323227] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd64de39-508a-4c6e-8891-44d146f301bd" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.323293] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd64de39-508a-4c6e-8891-44d146f301bd" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.323495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd64de39-508a-4c6e-8891-44d146f301bd" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.324056] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd64de39-508a-4c6e-8891-44d146f301bd',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.708497] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4739c3c-8ad5-4540-a6bb-cc50fab810cc in Status: SUCCESS [ 948.708765] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.826360] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd64de39-508a-4c6e-8891-44d146f301bd with status ACTIVE [ 948.826739] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.826739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.826904] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.827094] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.827159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.827295] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.827424] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.827488] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.827682] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.827755] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.827900] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.827988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.828061] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.828235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.828266] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.828484] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd64de39-508a-4c6e-8891-44d146f301bd is going to be updated. [ 948.830304] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.830443] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.853418] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.853418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.853418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.853418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.853418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.853418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd64de39-508a-4c6e-8891-44d146f301bd" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.136135] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: SUCCESS [ 949.136135] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e deletion is rescheduled due to dependency. [ 949.136135] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.136135] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.136135] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.136135] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.136588] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.136588] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.136588] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.136588] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.136588] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.639106] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.141759] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.645570] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.645929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.645929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.646061] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.646159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.646273] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e is going to be updated. [ 950.684541] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.684706] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.684778] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.685323] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.685323] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.701124] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: IN_PROGRESS for 2s [ 952.492314] env[66994]: INFO networking_nsxv3.common.synchronization [req-b834280a-b6c6-415b-bdce-8d09da836f62 req-04ec2735-7cfc-4469-90f1-9729d61eb995 tempest-ServerPasswordTestJSON-1820551532 tempest-ServerPasswordTestJSON-1820551532-project-member] Enqueued Resource ID: c4739c3c-8ad5-4540-a6bb-cc50fab810cc with Priority: HIGHEST for action security_group_members [ 952.492986] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4739c3c-8ad5-4540-a6bb-cc50fab810cc with Priority: HIGHEST for action security_group_members [ 952.493348] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.493554] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.493621] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.493860] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.494033] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.494173] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.494242] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.494397] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.494480] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.494812] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4739c3c-8ad5-4540-a6bb-cc50fab810cc',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.712358] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: SUCCESS [ 952.712618] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.712969] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.712969] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.713179] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.713311] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.713416] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.713591] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.713692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.713809] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.713914] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.923025] env[66994]: INFO networking_nsxv3.common.synchronization [req-5f6c86da-3e6f-46da-a4a3-bc09b9e0b169 req-4112e5b1-aa91-47e8-96f7-7d2f46e8f031 tempest-ServerRescueTestJSONUnderV235-453137144 tempest-ServerRescueTestJSONUnderV235-453137144-project-member] Enqueued Resource ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 with Priority: HIGHEST for action security_group_members [ 952.923025] env[66994]: INFO networking_nsxv3.common.synchronization [req-5f6c86da-3e6f-46da-a4a3-bc09b9e0b169 req-4112e5b1-aa91-47e8-96f7-7d2f46e8f031 tempest-ServerRescueTestJSONUnderV235-453137144 tempest-ServerRescueTestJSONUnderV235-453137144-project-member] Enqueued Resource ID: 22ebc36a-ff8c-4b20-aad2-f6d4235a368a with Priority: HIGHEST for action security_group_members [ 952.923025] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 with Priority: HIGHEST for action security_group_members [ 952.923025] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22ebc36a-ff8c-4b20-aad2-f6d4235a368a with Priority: HIGHEST for action security_group_members [ 952.923025] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-f732d92a-92e7-4f0e-8801-62a1e2b456e4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.923025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.923025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.923025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.923025] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.923025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.923025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.925604] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.926648] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.927560] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.928673] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-22ebc36a-ff8c-4b20-aad2-f6d4235a368a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.929109] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22ebc36a-ff8c-4b20-aad2-f6d4235a368a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.929109] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22ebc36a-ff8c-4b20-aad2-f6d4235a368a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.929322] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22ebc36a-ff8c-4b20-aad2-f6d4235a368a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.929379] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.929470] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.929524] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.929698] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.929786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.929913] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22ebc36a-ff8c-4b20-aad2-f6d4235a368a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.971988] env[66994]: INFO networking_nsxv3.common.synchronization [req-5f6c86da-3e6f-46da-a4a3-bc09b9e0b169 req-4112e5b1-aa91-47e8-96f7-7d2f46e8f031 tempest-ServerRescueTestJSONUnderV235-453137144 tempest-ServerRescueTestJSONUnderV235-453137144-project-member] Enqueued Resource ID: 22ebc36a-ff8c-4b20-aad2-f6d4235a368a with Priority: HIGHEST for action security_group_rules [ 952.972199] env[66994]: INFO networking_nsxv3.common.synchronization [req-5f6c86da-3e6f-46da-a4a3-bc09b9e0b169 req-4112e5b1-aa91-47e8-96f7-7d2f46e8f031 tempest-ServerRescueTestJSONUnderV235-453137144 tempest-ServerRescueTestJSONUnderV235-453137144-project-member] Enqueued Resource ID: 22ebc36a-ff8c-4b20-aad2-f6d4235a368a with Priority: HIGHEST for action security_group_members [ 952.972334] env[66994]: INFO networking_nsxv3.common.synchronization [req-5f6c86da-3e6f-46da-a4a3-bc09b9e0b169 req-4112e5b1-aa91-47e8-96f7-7d2f46e8f031 tempest-ServerRescueTestJSONUnderV235-453137144 tempest-ServerRescueTestJSONUnderV235-453137144-project-member] Enqueued Resource ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 with Priority: HIGHEST for action security_group_rules [ 952.972459] env[66994]: INFO networking_nsxv3.common.synchronization [req-5f6c86da-3e6f-46da-a4a3-bc09b9e0b169 req-4112e5b1-aa91-47e8-96f7-7d2f46e8f031 tempest-ServerRescueTestJSONUnderV235-453137144 tempest-ServerRescueTestJSONUnderV235-453137144-project-member] Enqueued Resource ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 with Priority: HIGHEST for action security_group_members [ 952.972581] env[66994]: INFO networking_nsxv3.common.synchronization [req-5f6c86da-3e6f-46da-a4a3-bc09b9e0b169 req-4112e5b1-aa91-47e8-96f7-7d2f46e8f031 tempest-ServerRescueTestJSONUnderV235-453137144 tempest-ServerRescueTestJSONUnderV235-453137144-project-member] Enqueued Resource ID: 7299cc3c-d2b5-4558-baff-e263c7dfe173 with Priority: HIGHEST for action port [ 952.973069] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22ebc36a-ff8c-4b20-aad2-f6d4235a368a with Priority: HIGHEST for action security_group_rules [ 952.973209] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 with Priority: HIGHEST for action security_group_rules [ 952.973307] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7299cc3c-d2b5-4558-baff-e263c7dfe173 with Priority: HIGHEST for action port [ 952.973424] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22ebc36a-ff8c-4b20-aad2-f6d4235a368a with Priority: HIGHEST for action security_group_members [ 952.973470] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 with Priority: HIGHEST for action security_group_members [ 952.973772] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22ebc36a-ff8c-4b20-aad2-f6d4235a368a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.973926] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22ebc36a-ff8c-4b20-aad2-f6d4235a368a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.973995] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22ebc36a-ff8c-4b20-aad2-f6d4235a368a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.974257] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22ebc36a-ff8c-4b20-aad2-f6d4235a368a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.974340] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22ebc36a-ff8c-4b20-aad2-f6d4235a368a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.975165] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f732d92a-92e7-4f0e-8801-62a1e2b456e4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.975345] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.975345] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.975625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.975625] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.976484] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-7299cc3c-d2b5-4558-baff-e263c7dfe173 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.977064] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7299cc3c-d2b5-4558-baff-e263c7dfe173" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.977064] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7299cc3c-d2b5-4558-baff-e263c7dfe173" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.977064] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7299cc3c-d2b5-4558-baff-e263c7dfe173" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.977064] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7299cc3c-d2b5-4558-baff-e263c7dfe173',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.977892] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-22ebc36a-ff8c-4b20-aad2-f6d4235a368a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.977988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22ebc36a-ff8c-4b20-aad2-f6d4235a368a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.978580] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-f732d92a-92e7-4f0e-8801-62a1e2b456e4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.978580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.000025] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.000025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.000025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.000025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.000025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.000025] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.000025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.000025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.000025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.000025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.000025] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4739c3c-8ad5-4540-a6bb-cc50fab810cc is going to be updated. [ 953.028086] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.028180] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.028308] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.028518] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.028824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.038604] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4739c3c-8ad5-4540-a6bb-cc50fab810cc in Status: IN_PROGRESS for 2s [ 953.216616] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.216771] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.216838] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.217049] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.217211] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.217307] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.217366] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.217508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.217592] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.217676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.217813] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.217901] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.217961] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.218110] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.218242] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.218328] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.218579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.218742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.218826] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.218907] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.218995] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.432096] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.433073] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22ebc36a-ff8c-4b20-aad2-f6d4235a368a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.479274] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-22ebc36a-ff8c-4b20-aad2-f6d4235a368a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.479758] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22ebc36a-ff8c-4b20-aad2-f6d4235a368a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.480383] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7299cc3c-d2b5-4558-baff-e263c7dfe173 with status ACTIVE [ 953.480383] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.480383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.480567] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.480692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.480787] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.481014] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.481131] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.481198] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.481401] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.481488] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.481717] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.481863] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.481912] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.482100] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.482201] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.482312] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7299cc3c-d2b5-4558-baff-e263c7dfe173 is going to be updated. [ 953.483666] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-f732d92a-92e7-4f0e-8801-62a1e2b456e4 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.483761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.492312] env[66994]: INFO networking_nsxv3.common.synchronization [req-b269bd41-a0cf-4d73-9ecb-cd82a471e1b8 req-c4d9c361-2b33-4234-895e-69695ee3f557 tempest-ServerRescueTestJSONUnderV235-453137144 tempest-ServerRescueTestJSONUnderV235-453137144-project-member] Enqueued Resource ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 with Priority: HIGHEST for action security_group_members [ 953.492490] env[66994]: INFO networking_nsxv3.common.synchronization [req-b269bd41-a0cf-4d73-9ecb-cd82a471e1b8 req-c4d9c361-2b33-4234-895e-69695ee3f557 tempest-ServerRescueTestJSONUnderV235-453137144 tempest-ServerRescueTestJSONUnderV235-453137144-project-member] Enqueued Resource ID: 22ebc36a-ff8c-4b20-aad2-f6d4235a368a with Priority: HIGHEST for action security_group_members [ 953.492970] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 with Priority: HIGHEST for action security_group_members [ 953.493317] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22ebc36a-ff8c-4b20-aad2-f6d4235a368a with Priority: HIGHEST for action security_group_members [ 953.493639] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-f732d92a-92e7-4f0e-8801-62a1e2b456e4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.493733] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.493944] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-22ebc36a-ff8c-4b20-aad2-f6d4235a368a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.493992] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22ebc36a-ff8c-4b20-aad2-f6d4235a368a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.506441] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.506645] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.506694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.507501] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.507501] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.507501] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7299cc3c-d2b5-4558-baff-e263c7dfe173" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.571575] env[66994]: INFO networking_nsxv3.common.synchronization [req-b269bd41-a0cf-4d73-9ecb-cd82a471e1b8 req-c4d9c361-2b33-4234-895e-69695ee3f557 tempest-ServerRescueTestJSONUnderV235-453137144 tempest-ServerRescueTestJSONUnderV235-453137144-project-member] Enqueued Resource ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 with Priority: HIGHEST for action security_group_rules [ 953.571766] env[66994]: INFO networking_nsxv3.common.synchronization [req-b269bd41-a0cf-4d73-9ecb-cd82a471e1b8 req-c4d9c361-2b33-4234-895e-69695ee3f557 tempest-ServerRescueTestJSONUnderV235-453137144 tempest-ServerRescueTestJSONUnderV235-453137144-project-member] Enqueued Resource ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 with Priority: HIGHEST for action security_group_members [ 953.572618] env[66994]: INFO networking_nsxv3.common.synchronization [req-b269bd41-a0cf-4d73-9ecb-cd82a471e1b8 req-c4d9c361-2b33-4234-895e-69695ee3f557 tempest-ServerRescueTestJSONUnderV235-453137144 tempest-ServerRescueTestJSONUnderV235-453137144-project-member] Enqueued Resource ID: 7299cc3c-d2b5-4558-baff-e263c7dfe173 with Priority: HIGHEST for action port [ 953.572618] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 with Priority: HIGHEST for action security_group_rules [ 953.572744] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 with Priority: HIGHEST for action security_group_members [ 953.572744] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7299cc3c-d2b5-4558-baff-e263c7dfe173 with Priority: HIGHEST for action port [ 953.573049] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f732d92a-92e7-4f0e-8801-62a1e2b456e4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.573169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.573423] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-f732d92a-92e7-4f0e-8801-62a1e2b456e4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.573590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.574099] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-7299cc3c-d2b5-4558-baff-e263c7dfe173 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.574099] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7299cc3c-d2b5-4558-baff-e263c7dfe173" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.574099] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7299cc3c-d2b5-4558-baff-e263c7dfe173" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.574099] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7299cc3c-d2b5-4558-baff-e263c7dfe173" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.574365] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7299cc3c-d2b5-4558-baff-e263c7dfe173',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.722604] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88bd36a2-b7c7-405c-ba4b-c36eb190f52e: rpc.has_security_group_logging(os_id): False [ 953.745544] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.746476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.746476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.746476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.746669] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.746942] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.747199] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.747314] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.747576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.747688] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.747907] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.748055] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.748138] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.748342] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.748426] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.748635] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.748743] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.748797] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.748959] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.749048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.749135] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e is going to be updated. [ 953.818896] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.819134] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.819179] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.819457] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.819664] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.838287] env[66994]: INFO networking_nsxv3.common.synchronization [req-59f22838-8878-4515-8161-205fba0d7315 req-c737444c-e877-4c86-97ce-d63f527785c8 tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 953.838965] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 953.839949] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.839949] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.839949] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.839949] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.840234] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.840234] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.840234] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.840360] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.840473] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.840567] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.842428] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: IN_PROGRESS for 2s [ 953.935135] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.936277] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22ebc36a-ff8c-4b20-aad2-f6d4235a368a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.077950] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7299cc3c-d2b5-4558-baff-e263c7dfe173 with status ACTIVE [ 954.078258] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.078462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.078556] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.078881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.079036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.079240] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.079354] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.079404] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.079979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.079979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.080193] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.080303] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.080388] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.080518] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.080603] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.080676] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7299cc3c-d2b5-4558-baff-e263c7dfe173 is going to be updated. [ 954.107056] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.107221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.107282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.107494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.107631] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.108024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7299cc3c-d2b5-4558-baff-e263c7dfe173" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.225084] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-475 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.225084] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-475" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.225084] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-475" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.225252] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-475" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.225601] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.225680] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.225797] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.226594] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.226751] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.226960] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.227136] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.227260] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.227371] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.227483] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.227590] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.227724] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.255278] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.255515] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 954.255697] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.255880] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-475" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.256221] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-c301d66d-c469-47d9-a9ca-b0566e45522d taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.256397] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-c301d66d-c469-47d9-a9ca-b0566e45522d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.256575] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-c301d66d-c469-47d9-a9ca-b0566e45522d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.256957] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-c301d66d-c469-47d9-a9ca-b0566e45522d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.261054] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c301d66d-c469-47d9-a9ca-b0566e45522d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.345027] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.345027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.345027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.345027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.345323] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.345379] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.345661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.345661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.345794] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.346587] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.346587] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d88934f6-85c4-4f45-a1fc-042377e3901a already deleted. [ 954.346587] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.438361] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.438532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.438591] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.438808] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.438900] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.439012] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 is going to be updated. [ 954.440262] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.440376] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.440444] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.440632] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.440714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.440817] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22ebc36a-ff8c-4b20-aad2-f6d4235a368a is going to be created. [ 954.464170] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.464331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.464404] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.465008] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.465206] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.468752] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.468929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.469049] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.469298] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.469484] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.480045] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22ebc36a-ff8c-4b20-aad2-f6d4235a368a in Status: UNINITIALIZED for 2s [ 954.480763] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 in Status: IN_PROGRESS for 2s [ 954.763627] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.763627] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.763627] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.764062] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.764062] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.764404] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port c301d66d-c469-47d9-a9ca-b0566e45522d not found, creating... [ 954.764685] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.764832] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.764944] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.765206] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.765339] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.765660] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.765815] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.765931] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.767097] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.767097] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.767097] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: c301d66d-c469-47d9-a9ca-b0566e45522d is going to be created. [ 954.787712] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.787981] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.788134] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.788402] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.788661] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.788917] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-c301d66d-c469-47d9-a9ca-b0566e45522d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.047752] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4739c3c-8ad5-4540-a6bb-cc50fab810cc in Status: SUCCESS [ 955.048023] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4739c3c-8ad5-4540-a6bb-cc50fab810cc deletion is rescheduled due to dependency. [ 955.048157] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.514113] env[66994]: INFO networking_nsxv3.common.synchronization [req-59f22838-8878-4515-8161-205fba0d7315 req-c345a59f-5fca-44bf-a991-8f130f8de3b6 service nova] Enqueued Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_rules [ 955.514313] env[66994]: INFO networking_nsxv3.common.synchronization [req-59f22838-8878-4515-8161-205fba0d7315 req-c345a59f-5fca-44bf-a991-8f130f8de3b6 service nova] Enqueued Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 955.514450] env[66994]: INFO networking_nsxv3.common.synchronization [req-59f22838-8878-4515-8161-205fba0d7315 req-c345a59f-5fca-44bf-a991-8f130f8de3b6 service nova] Enqueued Resource ID: c301d66d-c469-47d9-a9ca-b0566e45522d with Priority: HIGHEST for action port [ 955.514982] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_rules [ 955.519140] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 955.519140] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c301d66d-c469-47d9-a9ca-b0566e45522d with Priority: HIGHEST for action port [ 955.520316] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.520316] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.520494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.520676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.520765] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.521615] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.521733] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.521798] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.521972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.522137] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.522234] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.522341] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.522429] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.522516] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.522603] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.523925] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-c301d66d-c469-47d9-a9ca-b0566e45522d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.524088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c301d66d-c469-47d9-a9ca-b0566e45522d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.524670] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c301d66d-c469-47d9-a9ca-b0566e45522d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.524670] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c301d66d-c469-47d9-a9ca-b0566e45522d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.524670] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c301d66d-c469-47d9-a9ca-b0566e45522d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.855879] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: SUCCESS [ 955.856212] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.026660] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.026803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.027023] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.028875] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c301d66d-c469-47d9-a9ca-b0566e45522d with status ACTIVE [ 956.028875] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.028875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.028875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.028875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.028875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.028875] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.028875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.028875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.029243] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.029243] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.029381] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.029428] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.029494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.030672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.034709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.034709] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c301d66d-c469-47d9-a9ca-b0566e45522d is going to be updated. [ 956.060485] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.060673] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.060762] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.060985] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.061143] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.061304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c301d66d-c469-47d9-a9ca-b0566e45522d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.291518] env[66994]: INFO networking_nsxv3.common.synchronization [req-ed4db206-e714-48f9-8d9f-0e66544692c9 req-adb15dc8-b72d-4c41-bd30-29522fbac110 tempest-AttachVolumeNegativeTest-1341698298 tempest-AttachVolumeNegativeTest-1341698298-project-member] Enqueued Resource ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f with Priority: HIGHEST for action security_group_members [ 956.292348] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f with Priority: HIGHEST for action security_group_members [ 956.292723] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.292852] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.292920] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.293192] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.293356] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.293450] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.293513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.293665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.293750] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.293861] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dbf99f5-e2f2-4d4a-a2c0-855c798d247f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.496629] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 in Status: SUCCESS [ 956.496629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.497853] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22ebc36a-ff8c-4b20-aad2-f6d4235a368a in Status: SUCCESS [ 956.497853] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22ebc36a-ff8c-4b20-aad2-f6d4235a368a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.497853] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.497853] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.497853] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.497853] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.498192] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.498225] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.498337] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.498449] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.499639] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22ebc36a-ff8c-4b20-aad2-f6d4235a368a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.499639] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22ebc36a-ff8c-4b20-aad2-f6d4235a368a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.499812] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.499883] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.500264] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.500264] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.500427] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.500522] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22ebc36a-ff8c-4b20-aad2-f6d4235a368a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.536313] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.698816] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-532 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.699109] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-532" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.699288] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-532" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.699663] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-532" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.700042] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.700272] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.700441] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.700750] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.700930] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.701209] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 956.701331] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 956.701440] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 956.701548] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 956.701678] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 956.701753] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 956.701886] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 956.722681] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 956.722850] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 956.722987] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 956.723305] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-532" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.723523] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-372ef9b6-5fae-44c8-b6b5-0d42fbcdf9c6 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.723652] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-372ef9b6-5fae-44c8-b6b5-0d42fbcdf9c6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.723800] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-372ef9b6-5fae-44c8-b6b5-0d42fbcdf9c6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.724171] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-372ef9b6-5fae-44c8-b6b5-0d42fbcdf9c6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.724312] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('372ef9b6-5fae-44c8-b6b5-0d42fbcdf9c6',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.797133] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.797133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.797133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.797133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.797133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.797133] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.797133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.797133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.797133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.797133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.797133] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f already deleted. [ 956.797133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.002809] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.004580] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.004580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.004580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.004580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.004860] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.004900] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.005032] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.005084] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.005407] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.005407] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.005503] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22ebc36a-ff8c-4b20-aad2-f6d4235a368a is going to be deleted. [ 957.038100] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.038248] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.038324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.038527] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.038632] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.038762] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22ebc36a-ff8c-4b20-aad2-f6d4235a368a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.039223] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.039486] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.039628] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.039852] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.039941] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.040114] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d88934f6-85c4-4f45-a1fc-042377e3901a is going to be created. [ 957.041649] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22ebc36a-ff8c-4b20-aad2-f6d4235a368a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.041822] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22ebc36a-ff8c-4b20-aad2-f6d4235a368a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.041985] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.042112] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.042177] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.042323] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.042400] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.042492] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22ebc36a-ff8c-4b20-aad2-f6d4235a368a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.066774] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.066927] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.067070] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.067201] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.067363] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.077200] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: UNINITIALIZED for 2s [ 957.226819] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.227063] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.227231] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.227471] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.227621] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.227835] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 372ef9b6-5fae-44c8-b6b5-0d42fbcdf9c6 not found, creating... [ 957.228148] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.228342] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.228431] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.228618] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.228753] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.229040] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.229194] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.229309] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.229501] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.229630] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.229780] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 372ef9b6-5fae-44c8-b6b5-0d42fbcdf9c6 is going to be created. [ 957.253084] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.253440] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.253666] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.254119] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.254439] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.254702] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-372ef9b6-5fae-44c8-b6b5-0d42fbcdf9c6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.511350] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.545791] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.546960] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.547023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.547332] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.547466] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.547740] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.547888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.547971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.548258] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.548345] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.548454] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22ebc36a-ff8c-4b20-aad2-f6d4235a368a already deleted. [ 957.548567] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22ebc36a-ff8c-4b20-aad2-f6d4235a368a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.548710] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22ebc36a-ff8c-4b20-aad2-f6d4235a368a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.554151] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22ebc36a-ff8c-4b20-aad2-f6d4235a368a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.554477] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22ebc36a-ff8c-4b20-aad2-f6d4235a368a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.554742] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.554970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.554970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.555413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.555413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.555569] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22ebc36a-ff8c-4b20-aad2-f6d4235a368a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.016170] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.016170] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.016170] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.016993] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.016993] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.017066] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 is going to be updated. [ 958.019778] env[66994]: INFO networking_nsxv3.common.synchronization [req-ed4db206-e714-48f9-8d9f-0e66544692c9 req-d06993dc-20ce-4c6d-86cd-102a3dde0997 service nova] Enqueued Resource ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f with Priority: HIGHEST for action security_group_rules [ 958.019949] env[66994]: INFO networking_nsxv3.common.synchronization [req-ed4db206-e714-48f9-8d9f-0e66544692c9 req-d06993dc-20ce-4c6d-86cd-102a3dde0997 service nova] Enqueued Resource ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f with Priority: HIGHEST for action security_group_members [ 958.020364] env[66994]: INFO networking_nsxv3.common.synchronization [req-ed4db206-e714-48f9-8d9f-0e66544692c9 req-d06993dc-20ce-4c6d-86cd-102a3dde0997 service nova] Enqueued Resource ID: 372ef9b6-5fae-44c8-b6b5-0d42fbcdf9c6 with Priority: HIGHEST for action port [ 958.021101] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f with Priority: HIGHEST for action security_group_rules [ 958.021650] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f with Priority: HIGHEST for action security_group_members [ 958.021650] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 372ef9b6-5fae-44c8-b6b5-0d42fbcdf9c6 with Priority: HIGHEST for action port [ 958.022389] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.022637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.022718] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.022973] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.023120] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dbf99f5-e2f2-4d4a-a2c0-855c798d247f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.024832] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.024975] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.025070] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.025259] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.025708] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.025835] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.025904] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.026076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.026164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.026255] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dbf99f5-e2f2-4d4a-a2c0-855c798d247f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.027131] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-372ef9b6-5fae-44c8-b6b5-0d42fbcdf9c6 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.027242] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-372ef9b6-5fae-44c8-b6b5-0d42fbcdf9c6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.027279] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-372ef9b6-5fae-44c8-b6b5-0d42fbcdf9c6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.027435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-372ef9b6-5fae-44c8-b6b5-0d42fbcdf9c6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.027500] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('372ef9b6-5fae-44c8-b6b5-0d42fbcdf9c6',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.059363] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.059540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.059540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.060081] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.060081] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.061305] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22ebc36a-ff8c-4b20-aad2-f6d4235a368a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.065510] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.065510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.065510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.065510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.065510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.065510] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.065510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.065510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.065510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.065510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.065510] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22ebc36a-ff8c-4b20-aad2-f6d4235a368a already deleted. [ 958.065510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22ebc36a-ff8c-4b20-aad2-f6d4235a368a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.078386] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 in Status: IN_PROGRESS for 2s [ 958.531267] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.531404] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.531987] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6dbf99f5-e2f2-4d4a-a2c0-855c798d247f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.533039] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 372ef9b6-5fae-44c8-b6b5-0d42fbcdf9c6 with status ACTIVE [ 958.533140] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.533255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.533323] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.533539] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.533626] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.533790] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.533888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.533950] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.534134] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.534196] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.534373] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.534465] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.534523] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.534656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.534729] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.534825] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 372ef9b6-5fae-44c8-b6b5-0d42fbcdf9c6 is going to be updated. [ 958.557344] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.557543] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.557618] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.557868] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.557993] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.558221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-372ef9b6-5fae-44c8-b6b5-0d42fbcdf9c6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.567053] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22ebc36a-ff8c-4b20-aad2-f6d4235a368a: rpc.has_security_group_logging(os_id): False [ 958.589106] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.589252] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.589313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.589511] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.589609] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.589901] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.590132] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.590198] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.590320] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.590402] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.590536] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22ebc36a-ff8c-4b20-aad2-f6d4235a368a is going to be created. [ 958.623844] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/22ebc36a-ff8c-4b20-aad2-f6d4235a368a], does not exist path=[/infra/domains/default/groups/22ebc36a-ff8c-4b20-aad2-f6d4235a368a]."\n}' [ 958.623993] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22ebc36a-ff8c-4b20-aad2-f6d4235a368a failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/22ebc36a-ff8c-4b20-aad2-f6d4235a368a [ 958.624094] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 958.679488] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.679663] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.679698] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.679960] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.681090] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.681370] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.681513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.681581] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.681958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.681958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.682060] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.682119] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.682313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.682313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.682423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.682464] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22ebc36a-ff8c-4b20-aad2-f6d4235a368a is going to be created. [ 958.716246] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/22ebc36a-ff8c-4b20-aad2-f6d4235a368a], does not exist path=[/infra/domains/default/groups/22ebc36a-ff8c-4b20-aad2-f6d4235a368a]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/22ebc36a-ff8c-4b20-aad2-f6d4235a368a [ 958.716246] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22ebc36a-ff8c-4b20-aad2-f6d4235a368a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.716246] env[66994]: Traceback (most recent call last): [ 958.716246] env[66994]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 958.716246] env[66994]: return func(*args, **kwargs) [ 958.716246] env[66994]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 958.716246] env[66994]: res.raise_for_status() [ 958.716246] env[66994]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 958.716246] env[66994]: raise HTTPError(http_error_msg, response=self) [ 958.716246] env[66994]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/22ebc36a-ff8c-4b20-aad2-f6d4235a368a [ 958.716246] env[66994]: During handling of the above exception, another exception occurred: [ 958.716246] env[66994]: Traceback (most recent call last): [ 958.716246] env[66994]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 958.716246] env[66994]: listener.cb(fileno) [ 958.716246] env[66994]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 958.716246] env[66994]: result = function(*args, **kwargs) [ 958.716246] env[66994]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 958.716246] env[66994]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 958.716246] env[66994]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 958.716246] env[66994]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 958.716246] env[66994]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 958.716246] env[66994]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 958.716246] env[66994]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 958.716246] env[66994]: res.raise_for_status() [ 958.716246] env[66994]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 958.716246] env[66994]: raise HTTPError(http_error_msg, response=self) [ 958.716246] env[66994]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/22ebc36a-ff8c-4b20-aad2-f6d4235a368a [ 958.716246] env[66994]: Removing descriptor: 53 [ 958.903745] env[66994]: INFO networking_nsxv3.common.synchronization [req-04198480-aeab-468a-96ca-15a0509d9f6a req-8a3dc982-9ee0-4a9b-b37d-1c83690adb04 tempest-ServersTestFqdnHostnames-1753183055 tempest-ServersTestFqdnHostnames-1753183055-project-member] Enqueued Resource ID: c0f823fa-9f2d-40f7-9630-8dee9229983a with Priority: HIGHEST for action security_group_members [ 958.904450] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f823fa-9f2d-40f7-9630-8dee9229983a with Priority: HIGHEST for action security_group_members [ 958.904780] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0f823fa-9f2d-40f7-9630-8dee9229983a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.904906] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.904993] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.905235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.905392] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.905533] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.905595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.905753] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.905839] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.905932] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0f823fa-9f2d-40f7-9630-8dee9229983a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.034108] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6dbf99f5-e2f2-4d4a-a2c0-855c798d247f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.089749] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: SUCCESS [ 959.092346] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.092346] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.092346] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.092346] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.092346] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.092346] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.092741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.092741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.092741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.092826] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.249151] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-286 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.249151] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-286" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.249151] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-286" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.249151] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-286" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.249882] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.251359] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.251359] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.251359] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.251359] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.252264] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.253126] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 959.253126] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 959.253126] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 959.253707] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.254353] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 959.254826] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 959.275358] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 959.275358] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 959.275469] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 959.276108] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-286" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.276108] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-cae4cd36-dfbc-41f3-9277-9f33954ed07f taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.276298] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-cae4cd36-dfbc-41f3-9277-9f33954ed07f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.276298] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-cae4cd36-dfbc-41f3-9277-9f33954ed07f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.276671] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-cae4cd36-dfbc-41f3-9277-9f33954ed07f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.276827] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cae4cd36-dfbc-41f3-9277-9f33954ed07f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.408065] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.408231] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.408231] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.409021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.409021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.409021] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.409021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.409021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.409021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.409021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.409335] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0f823fa-9f2d-40f7-9630-8dee9229983a already deleted. [ 959.409335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.540165] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.540379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.540448] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.540633] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.540708] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.540950] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f is going to be created. [ 959.568112] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.568302] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.568368] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.568540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.568699] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.579713] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f in Status: UNINITIALIZED for 2s [ 959.595399] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.595644] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.595718] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.595959] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.596148] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.596275] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.596366] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.596612] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.598024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.598024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.598024] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.598024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.598024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.598024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.598024] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.598024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.598024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.598611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.598805] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.598938] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.599091] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.779911] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.780177] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.780302] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.780581] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.780730] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.780885] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port cae4cd36-dfbc-41f3-9277-9f33954ed07f not found, creating... [ 959.781179] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.781337] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.781451] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.781695] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.781798] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.782091] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.782248] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.782363] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.782595] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.782705] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.783013] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: cae4cd36-dfbc-41f3-9277-9f33954ed07f is going to be created. [ 959.803277] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.803497] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.803621] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.804038] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.804375] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.804696] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-cae4cd36-dfbc-41f3-9277-9f33954ed07f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.092924] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 in Status: SUCCESS [ 960.092924] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.092924] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.092924] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.092924] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.092924] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.092924] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.092924] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.092924] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.092924] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.092924] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.093640] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.093878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.094128] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.094299] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.094416] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.094734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.094873] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.095045] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.103186] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d88934f6-85c4-4f45-a1fc-042377e3901a: rpc.has_security_group_logging(os_id): False [ 960.124114] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.124114] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.124114] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.124114] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.124114] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.124462] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.124647] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.124748] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.124943] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.125063] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.125299] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.125420] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.125637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.125948] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.125948] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.126110] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.126725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.126725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.126725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.126725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.126725] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d88934f6-85c4-4f45-a1fc-042377e3901a is going to be created. [ 960.199045] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.200201] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.200345] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.200600] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.201943] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.215158] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: IN_PROGRESS for 2s [ 960.572539] env[66994]: INFO networking_nsxv3.common.synchronization [req-04198480-aeab-468a-96ca-15a0509d9f6a req-4b3800b9-84e1-4845-8228-7ce252e635fa service nova] Enqueued Resource ID: c0f823fa-9f2d-40f7-9630-8dee9229983a with Priority: HIGHEST for action security_group_rules [ 960.572719] env[66994]: INFO networking_nsxv3.common.synchronization [req-04198480-aeab-468a-96ca-15a0509d9f6a req-4b3800b9-84e1-4845-8228-7ce252e635fa service nova] Enqueued Resource ID: c0f823fa-9f2d-40f7-9630-8dee9229983a with Priority: HIGHEST for action security_group_members [ 960.572835] env[66994]: INFO networking_nsxv3.common.synchronization [req-04198480-aeab-468a-96ca-15a0509d9f6a req-4b3800b9-84e1-4845-8228-7ce252e635fa service nova] Enqueued Resource ID: cae4cd36-dfbc-41f3-9277-9f33954ed07f with Priority: HIGHEST for action port [ 960.573392] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f823fa-9f2d-40f7-9630-8dee9229983a with Priority: HIGHEST for action security_group_rules [ 960.573548] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f823fa-9f2d-40f7-9630-8dee9229983a with Priority: HIGHEST for action security_group_members [ 960.573736] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cae4cd36-dfbc-41f3-9277-9f33954ed07f with Priority: HIGHEST for action port [ 960.573916] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0f823fa-9f2d-40f7-9630-8dee9229983a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.574049] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.574118] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.574377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.574462] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0f823fa-9f2d-40f7-9630-8dee9229983a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.575642] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0f823fa-9f2d-40f7-9630-8dee9229983a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.575745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.575815] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.576034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.576226] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.576346] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.576497] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.576558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.576625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.576719] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0f823fa-9f2d-40f7-9630-8dee9229983a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.578510] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-cae4cd36-dfbc-41f3-9277-9f33954ed07f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.578630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cae4cd36-dfbc-41f3-9277-9f33954ed07f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.578680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cae4cd36-dfbc-41f3-9277-9f33954ed07f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.579078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cae4cd36-dfbc-41f3-9277-9f33954ed07f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.579078] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cae4cd36-dfbc-41f3-9277-9f33954ed07f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.598253] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-f732d92a-92e7-4f0e-8801-62a1e2b456e4 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.598253] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.598253] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.081226] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0f823fa-9f2d-40f7-9630-8dee9229983a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.081916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.083850] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0f823fa-9f2d-40f7-9630-8dee9229983a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.084788] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cae4cd36-dfbc-41f3-9277-9f33954ed07f with status ACTIVE [ 961.084990] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.085125] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.085187] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.085389] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.085510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.085704] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.085809] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.085870] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.086047] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.086129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.086312] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.086409] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.086464] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.086621] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.086683] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.086765] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cae4cd36-dfbc-41f3-9277-9f33954ed07f is going to be updated. [ 961.101587] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.113059] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.113216] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.113286] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.113494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.113640] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.113802] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cae4cd36-dfbc-41f3-9277-9f33954ed07f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.485387] env[66994]: INFO networking_nsxv3.common.synchronization [req-62fd2db9-9c94-461b-8e09-553ea26e7994 req-317f6a0d-361f-427f-bcff-ee30f0a56919 tempest-ServerActionsTestOtherA-355769928 tempest-ServerActionsTestOtherA-355769928-project-member] Enqueued Resource ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 with Priority: HIGHEST for action security_group_members [ 961.486081] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 with Priority: HIGHEST for action security_group_members [ 961.486485] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.486625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.486707] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.487039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.487289] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.487459] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.487570] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.487754] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.487839] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.487934] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.589654] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0f823fa-9f2d-40f7-9630-8dee9229983a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.591612] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f in Status: SUCCESS [ 961.591981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.592090] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.592255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.592444] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.592588] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.592679] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.592868] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.593023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.593086] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.593204] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6dbf99f5-e2f2-4d4a-a2c0-855c798d247f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.604345] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.604632] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.604725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.604922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.605022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.605133] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 is going to be updated. [ 961.636961] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.637122] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.637202] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.637432] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.637582] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.646206] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 in Status: IN_PROGRESS for 2s [ 961.847417] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-732 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.847650] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-732" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.847763] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-732" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.848133] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-732" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.848781] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.848959] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.849273] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.849527] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.849678] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.849911] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 961.850068] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 961.850177] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 961.850283] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 961.850419] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 961.850617] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 961.850696] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 961.871090] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 961.871274] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 961.871411] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 961.871588] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-732" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.871908] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-aa6a7746-04e9-4f36-9b88-98f4a9a7ae9e taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.872097] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-aa6a7746-04e9-4f36-9b88-98f4a9a7ae9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.872216] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-aa6a7746-04e9-4f36-9b88-98f4a9a7ae9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.872557] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-aa6a7746-04e9-4f36-9b88-98f4a9a7ae9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.872717] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa6a7746-04e9-4f36-9b88-98f4a9a7ae9e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.990064] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.990221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.990296] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.990518] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.990610] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.990798] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.990895] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.990958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.991133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.991209] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.991297] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 already deleted. [ 961.991377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.096440] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.096440] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.096440] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.096440] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.096440] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.096440] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0f823fa-9f2d-40f7-9630-8dee9229983a is going to be created. [ 962.097179] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6dbf99f5-e2f2-4d4a-a2c0-855c798d247f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.127899] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.128319] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.128319] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.128396] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.128518] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.140561] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0f823fa-9f2d-40f7-9630-8dee9229983a in Status: UNINITIALIZED for 2s [ 962.235066] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: SUCCESS [ 962.235310] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.375868] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.376197] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.376630] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.377053] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.377157] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.377297] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port aa6a7746-04e9-4f36-9b88-98f4a9a7ae9e not found, creating... [ 962.377608] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.377818] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.378103] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.378372] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.378554] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.378984] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.379258] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.379387] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.379613] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.379770] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.379906] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: aa6a7746-04e9-4f36-9b88-98f4a9a7ae9e is going to be created. [ 962.402051] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.402051] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.402333] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.402524] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.402755] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.402998] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-aa6a7746-04e9-4f36-9b88-98f4a9a7ae9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.600871] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f: rpc.has_security_group_logging(os_id): False [ 962.624944] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.625228] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.625228] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.625601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.625601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.625827] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.625930] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.626034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.626278] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.626364] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.626469] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f is going to be created. [ 962.703941] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.706464] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.706772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.707048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.707319] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.724065] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f in Status: IN_PROGRESS for 2s [ 963.139346] env[66994]: INFO networking_nsxv3.common.synchronization [req-62fd2db9-9c94-461b-8e09-553ea26e7994 req-d68f2d54-aebb-4bfe-b610-ad96b69920dc service nova] Enqueued Resource ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 with Priority: HIGHEST for action security_group_rules [ 963.139346] env[66994]: INFO networking_nsxv3.common.synchronization [req-62fd2db9-9c94-461b-8e09-553ea26e7994 req-d68f2d54-aebb-4bfe-b610-ad96b69920dc service nova] Enqueued Resource ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 with Priority: HIGHEST for action security_group_members [ 963.139346] env[66994]: INFO networking_nsxv3.common.synchronization [req-62fd2db9-9c94-461b-8e09-553ea26e7994 req-d68f2d54-aebb-4bfe-b610-ad96b69920dc service nova] Enqueued Resource ID: aa6a7746-04e9-4f36-9b88-98f4a9a7ae9e with Priority: HIGHEST for action port [ 963.140238] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 with Priority: HIGHEST for action security_group_rules [ 963.140485] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 with Priority: HIGHEST for action security_group_members [ 963.140691] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa6a7746-04e9-4f36-9b88-98f4a9a7ae9e with Priority: HIGHEST for action port [ 963.141107] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.141357] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.141514] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.141809] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.141995] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.143072] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.146161] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.146161] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.146161] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.146161] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.146161] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.146161] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.146161] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.146161] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.146161] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.146161] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa6a7746-04e9-4f36-9b88-98f4a9a7ae9e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.146161] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa6a7746-04e9-4f36-9b88-98f4a9a7ae9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.148199] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa6a7746-04e9-4f36-9b88-98f4a9a7ae9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.148199] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa6a7746-04e9-4f36-9b88-98f4a9a7ae9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.148199] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa6a7746-04e9-4f36-9b88-98f4a9a7ae9e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.649893] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.651167] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.651313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.652417] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa6a7746-04e9-4f36-9b88-98f4a9a7ae9e with status ACTIVE [ 963.652417] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.652417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.652417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.652417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.652417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.652875] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.652875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.652875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.652875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.653475] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.653475] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.654790] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.654906] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.655292] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.655292] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.655408] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa6a7746-04e9-4f36-9b88-98f4a9a7ae9e is going to be updated. [ 963.659524] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 in Status: SUCCESS [ 963.659524] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.659524] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.659524] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.659695] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.659922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.659922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.660071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.660166] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.660280] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.682883] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.683075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.683149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.683427] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.683636] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.683895] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa6a7746-04e9-4f36-9b88-98f4a9a7ae9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.806918] env[66994]: INFO networking_nsxv3.common.synchronization [req-0330d5d0-59f2-4ee5-9fed-e64d53cfa09e req-1c5225c0-0065-4db1-b845-f10320f7a72e tempest-ServerRescueTestJSONUnderV235-453137144 tempest-ServerRescueTestJSONUnderV235-453137144-project-member] Enqueued Resource ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 with Priority: HIGHEST for action security_group_members [ 963.807515] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 with Priority: HIGHEST for action security_group_members [ 963.807830] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-f732d92a-92e7-4f0e-8801-62a1e2b456e4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.807931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.157186] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.161036] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0f823fa-9f2d-40f7-9630-8dee9229983a in Status: SUCCESS [ 964.161036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.161036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.161036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.161036] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.161036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.161036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.161036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.161036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.161036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.161036] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0f823fa-9f2d-40f7-9630-8dee9229983a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.163416] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.660263] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.660263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.660263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.660263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.660263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.660263] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 is going to be created. [ 964.662425] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0f823fa-9f2d-40f7-9630-8dee9229983a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.666768] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.695033] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.695033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.695033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.695033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.695033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.709472] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 in Status: UNINITIALIZED for 2s [ 964.742310] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f in Status: SUCCESS [ 964.742562] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.166781] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0f823fa-9f2d-40f7-9630-8dee9229983a: rpc.has_security_group_logging(os_id): False [ 965.170877] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.171039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.171116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.171335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.171426] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.171524] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 is going to be updated. [ 965.190661] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.190802] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.190900] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.191533] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.191533] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.191533] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.191774] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.191774] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.191955] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.192083] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.192240] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0f823fa-9f2d-40f7-9630-8dee9229983a is going to be created. [ 965.207738] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.207925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.208026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.208271] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.210022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.223978] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 in Status: IN_PROGRESS for 2s [ 965.300244] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.300244] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.300244] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.300472] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.301048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.359359] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0f823fa-9f2d-40f7-9630-8dee9229983a in Status: IN_PROGRESS for 2s [ 966.172080] env[66994]: INFO networking_nsxv3.common.synchronization [req-d915d754-fbc3-4c99-bedd-5f088d01842b req-62408181-922d-4ba5-88a0-c1d3537daa3d tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 966.172080] env[66994]: INFO networking_nsxv3.common.synchronization [req-d915d754-fbc3-4c99-bedd-5f088d01842b req-62408181-922d-4ba5-88a0-c1d3537daa3d tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d15cba36-9c0e-45f0-8225-a808a551bd40 with Priority: HIGHEST for action security_group_members [ 966.172396] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 966.172678] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d15cba36-9c0e-45f0-8225-a808a551bd40 with Priority: HIGHEST for action security_group_members [ 966.172742] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.172902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.173016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.173163] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.173274] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.173373] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.173441] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.175391] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.175391] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.175391] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.175391] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d15cba36-9c0e-45f0-8225-a808a551bd40 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.176887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.176887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.176887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.176887] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.176887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.176887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.176887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.176887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.176887] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.225124] env[66994]: INFO networking_nsxv3.common.synchronization [req-d915d754-fbc3-4c99-bedd-5f088d01842b req-62408181-922d-4ba5-88a0-c1d3537daa3d tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d15cba36-9c0e-45f0-8225-a808a551bd40 with Priority: HIGHEST for action security_group_rules [ 966.225298] env[66994]: INFO networking_nsxv3.common.synchronization [req-d915d754-fbc3-4c99-bedd-5f088d01842b req-62408181-922d-4ba5-88a0-c1d3537daa3d tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d15cba36-9c0e-45f0-8225-a808a551bd40 with Priority: HIGHEST for action security_group_members [ 966.225431] env[66994]: INFO networking_nsxv3.common.synchronization [req-d915d754-fbc3-4c99-bedd-5f088d01842b req-62408181-922d-4ba5-88a0-c1d3537daa3d tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_rules [ 966.225615] env[66994]: INFO networking_nsxv3.common.synchronization [req-d915d754-fbc3-4c99-bedd-5f088d01842b req-62408181-922d-4ba5-88a0-c1d3537daa3d tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 966.225756] env[66994]: INFO networking_nsxv3.common.synchronization [req-d915d754-fbc3-4c99-bedd-5f088d01842b req-62408181-922d-4ba5-88a0-c1d3537daa3d tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: c301d66d-c469-47d9-a9ca-b0566e45522d with Priority: HIGHEST for action port [ 966.228420] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d15cba36-9c0e-45f0-8225-a808a551bd40 with Priority: HIGHEST for action security_group_rules [ 966.228420] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_rules [ 966.228420] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c301d66d-c469-47d9-a9ca-b0566e45522d with Priority: HIGHEST for action port [ 966.228420] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d15cba36-9c0e-45f0-8225-a808a551bd40 with Priority: HIGHEST for action security_group_members [ 966.228420] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 966.228638] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d15cba36-9c0e-45f0-8225-a808a551bd40 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.228638] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.228724] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.228900] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.229048] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.230383] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.230383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.230383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.230383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.230383] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.232406] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-c301d66d-c469-47d9-a9ca-b0566e45522d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.232406] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c301d66d-c469-47d9-a9ca-b0566e45522d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.232406] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c301d66d-c469-47d9-a9ca-b0566e45522d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.232406] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c301d66d-c469-47d9-a9ca-b0566e45522d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.232406] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c301d66d-c469-47d9-a9ca-b0566e45522d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.234695] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d15cba36-9c0e-45f0-8225-a808a551bd40 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.234695] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.234695] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.234695] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.679016] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.680503] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.722499] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 in Status: SUCCESS [ 966.722742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.722911] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.723224] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.723550] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.723674] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.723674] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.723796] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.723877] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.723974] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.724057] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.733565] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c301d66d-c469-47d9-a9ca-b0566e45522d with status ACTIVE [ 966.733801] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.733954] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.734051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.734257] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.734344] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.734523] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.734629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.734690] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.734963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.734963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.735102] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.735259] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.735259] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.735369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.735439] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.735557] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c301d66d-c469-47d9-a9ca-b0566e45522d is going to be updated. [ 966.737110] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.737110] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.739148] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d15cba36-9c0e-45f0-8225-a808a551bd40 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.739302] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.762159] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.762314] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.762957] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.762957] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.762957] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.762957] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c301d66d-c469-47d9-a9ca-b0566e45522d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.820681] env[66994]: INFO networking_nsxv3.common.synchronization [req-843da8ca-00fd-48f8-b945-aae38aab92fc req-85520adc-4b6d-4d99-9959-07c2899c895f tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 966.820681] env[66994]: INFO networking_nsxv3.common.synchronization [req-843da8ca-00fd-48f8-b945-aae38aab92fc req-85520adc-4b6d-4d99-9959-07c2899c895f tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d15cba36-9c0e-45f0-8225-a808a551bd40 with Priority: HIGHEST for action security_group_members [ 966.820681] env[66994]: INFO networking_nsxv3.common.synchronization [req-843da8ca-00fd-48f8-b945-aae38aab92fc req-85520adc-4b6d-4d99-9959-07c2899c895f tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e with Priority: HIGHEST for action security_group_members [ 966.821455] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 966.822310] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d15cba36-9c0e-45f0-8225-a808a551bd40 with Priority: HIGHEST for action security_group_members [ 966.822310] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e with Priority: HIGHEST for action security_group_members [ 966.822796] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.823034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.823988] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d15cba36-9c0e-45f0-8225-a808a551bd40 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.824211] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.824510] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.824672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.824765] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.825336] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.825426] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.825556] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.825614] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.825837] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.825970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.826124] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e351cb9-ed41-4a93-8257-1a5acb7b4f9e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.871687] env[66994]: INFO networking_nsxv3.common.synchronization [req-843da8ca-00fd-48f8-b945-aae38aab92fc req-85520adc-4b6d-4d99-9959-07c2899c895f tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e with Priority: HIGHEST for action security_group_rules [ 966.872151] env[66994]: INFO networking_nsxv3.common.synchronization [req-843da8ca-00fd-48f8-b945-aae38aab92fc req-85520adc-4b6d-4d99-9959-07c2899c895f tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e with Priority: HIGHEST for action security_group_members [ 966.872151] env[66994]: INFO networking_nsxv3.common.synchronization [req-843da8ca-00fd-48f8-b945-aae38aab92fc req-85520adc-4b6d-4d99-9959-07c2899c895f tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d15cba36-9c0e-45f0-8225-a808a551bd40 with Priority: HIGHEST for action security_group_rules [ 966.872297] env[66994]: INFO networking_nsxv3.common.synchronization [req-843da8ca-00fd-48f8-b945-aae38aab92fc req-85520adc-4b6d-4d99-9959-07c2899c895f tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d15cba36-9c0e-45f0-8225-a808a551bd40 with Priority: HIGHEST for action security_group_members [ 966.872491] env[66994]: INFO networking_nsxv3.common.synchronization [req-843da8ca-00fd-48f8-b945-aae38aab92fc req-85520adc-4b6d-4d99-9959-07c2899c895f tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_rules [ 966.872669] env[66994]: INFO networking_nsxv3.common.synchronization [req-843da8ca-00fd-48f8-b945-aae38aab92fc req-85520adc-4b6d-4d99-9959-07c2899c895f tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 966.872893] env[66994]: INFO networking_nsxv3.common.synchronization [req-843da8ca-00fd-48f8-b945-aae38aab92fc req-85520adc-4b6d-4d99-9959-07c2899c895f tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: c301d66d-c469-47d9-a9ca-b0566e45522d with Priority: HIGHEST for action port [ 966.873914] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e with Priority: HIGHEST for action security_group_rules [ 966.874667] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d15cba36-9c0e-45f0-8225-a808a551bd40 with Priority: HIGHEST for action security_group_rules [ 966.874667] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 966.874667] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c301d66d-c469-47d9-a9ca-b0566e45522d with Priority: HIGHEST for action port [ 966.874667] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_rules [ 966.874667] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e with Priority: HIGHEST for action security_group_members [ 966.875045] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d15cba36-9c0e-45f0-8225-a808a551bd40 with Priority: HIGHEST for action security_group_members [ 966.875390] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.875549] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.875691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.875998] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.876155] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e351cb9-ed41-4a93-8257-1a5acb7b4f9e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.880252] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d15cba36-9c0e-45f0-8225-a808a551bd40 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.880252] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.880252] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.880252] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.880252] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-c301d66d-c469-47d9-a9ca-b0566e45522d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.880252] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c301d66d-c469-47d9-a9ca-b0566e45522d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.880252] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c301d66d-c469-47d9-a9ca-b0566e45522d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.880252] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c301d66d-c469-47d9-a9ca-b0566e45522d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.880252] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c301d66d-c469-47d9-a9ca-b0566e45522d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.880252] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.880252] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.880252] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.880252] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.880252] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d15cba36-9c0e-45f0-8225-a808a551bd40 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.880252] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.183069] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.185028] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.228316] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.244918] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 in Status: IN_PROGRESS for 4s [ 967.329592] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e351cb9-ed41-4a93-8257-1a5acb7b4f9e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.374950] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0f823fa-9f2d-40f7-9630-8dee9229983a in Status: SUCCESS [ 967.375111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.383202] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c301d66d-c469-47d9-a9ca-b0566e45522d with status ACTIVE [ 967.383202] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.383441] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.383496] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.383803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.383992] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.384072] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.384130] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.384195] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.384425] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.384425] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.384634] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.384740] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.384795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.384974] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.385351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.385351] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c301d66d-c469-47d9-a9ca-b0566e45522d is going to be updated. [ 967.386555] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.386658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.408770] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.408770] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.408770] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.408770] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.408955] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.409115] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c301d66d-c469-47d9-a9ca-b0566e45522d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.685322] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.685540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.685635] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.685884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.685991] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.686184] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d15cba36-9c0e-45f0-8225-a808a551bd40 is going to be created. [ 967.687997] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.688149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.688239] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.688404] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.688491] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.688604] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d88934f6-85c4-4f45-a1fc-042377e3901a is going to be updated. [ 967.715563] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.715816] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.715860] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.716070] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.716236] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.718991] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.719138] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.719209] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.719405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.719546] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.731306] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a66f6cb4-94dc-4701-ac62-f6c6e4d4e305: rpc.has_security_group_logging(os_id): False [ 967.735289] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: IN_PROGRESS for 2s [ 967.736742] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d15cba36-9c0e-45f0-8225-a808a551bd40 in Status: UNINITIALIZED for 2s [ 967.766820] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.770637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.770637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.770961] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.770996] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.771367] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.771494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.771564] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.771739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.771820] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.771917] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 is going to be created. [ 967.832562] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e351cb9-ed41-4a93-8257-1a5acb7b4f9e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.850266] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.850462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.850546] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.850791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.851186] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.865548] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 in Status: IN_PROGRESS for 2s [ 968.337576] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.337576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.337576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.337576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.337576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.337576] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e is going to be created. [ 968.371063] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.371267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.371310] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.371517] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.371772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.383622] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e in Status: UNINITIALIZED for 2s [ 969.262027] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 in Status: SUCCESS [ 969.262027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.262027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.262027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.262027] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.262027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.262027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.262027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.262027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.262027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.262027] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-f732d92a-92e7-4f0e-8801-62a1e2b456e4 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.262027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.262027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.262027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.262027] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.262027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.262027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.262027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.262027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.262883] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.262883] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.263978] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.264314] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.264702] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.265087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.265298] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.265609] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.265842] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.267019] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.748677] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d15cba36-9c0e-45f0-8225-a808a551bd40 in Status: SUCCESS [ 969.749045] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.749699] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: SUCCESS [ 969.749860] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.750056] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.750350] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.750641] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.750823] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.750923] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.751512] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.751603] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.751703] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.752583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.752762] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.753061] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.753061] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.753213] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.753262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.753433] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.753484] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.771110] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f732d92a-92e7-4f0e-8801-62a1e2b456e4: rpc.has_security_group_logging(os_id): False [ 969.772517] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.772667] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.772718] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.773071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.796603] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.796732] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.802287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.802287] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.802287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.802287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.802287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.802287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.802287] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 is going to be updated. [ 969.802287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.802287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.802287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.802287] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.802287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.802287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.802287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.802825] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.802856] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.803055] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.803055] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.803190] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.803230] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.805154] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.805154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.805154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.805154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.805154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.805154] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 is going to be updated. [ 969.847364] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.847364] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.847364] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.847364] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.847364] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.859305] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 in Status: IN_PROGRESS for 2s [ 969.882717] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 in Status: SUCCESS [ 969.882717] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.891861] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.891861] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.891861] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.891861] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.891861] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.912662] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 in Status: IN_PROGRESS for 2s [ 970.254977] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.257816] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.396458] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e in Status: SUCCESS [ 970.396458] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.396458] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.396458] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.396458] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.396458] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.396458] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.396458] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.396458] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.396458] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e351cb9-ed41-4a93-8257-1a5acb7b4f9e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.757917] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.759679] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.900330] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e351cb9-ed41-4a93-8257-1a5acb7b4f9e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.262786] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.262876] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.262912] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.264166] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.264166] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.264166] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d15cba36-9c0e-45f0-8225-a808a551bd40 is going to be updated. [ 971.264874] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.265237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.265350] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.269328] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.269429] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.269563] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d88934f6-85c4-4f45-a1fc-042377e3901a is going to be updated. [ 971.318691] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.318691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.318691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.318940] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.319804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.325054] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.327021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.327021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.327021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.327021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.335083] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: IN_PROGRESS for 2s [ 971.337908] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d15cba36-9c0e-45f0-8225-a808a551bd40 in Status: IN_PROGRESS for 2s [ 971.403893] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e351cb9-ed41-4a93-8257-1a5acb7b4f9e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.669017] env[66994]: INFO networking_nsxv3.common.synchronization [req-cf5fd8b1-fc0a-467f-af7c-489a52063d93 req-2bd90225-5cf5-408d-9487-9b9204b8f8dc tempest-ServerActionsTestJSON-501116813 tempest-ServerActionsTestJSON-501116813-project-member] Enqueued Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_members [ 971.669361] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_members [ 971.670678] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a75cae-9123-4d4d-9e51-add1196ab1f2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.670678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.670678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.670678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.670678] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.670678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.670678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.670678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.671164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.671164] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.870326] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 in Status: SUCCESS [ 971.870683] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 deletion is rescheduled due to dependency. [ 971.870913] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.905739] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.905924] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.906026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.906266] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.906378] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.906498] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e is going to be updated. [ 971.929780] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 in Status: SUCCESS [ 971.929780] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.929780] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.929780] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.929780] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f732d92a-92e7-4f0e-8801-62a1e2b456e4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.945061] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.945061] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.945061] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.945061] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.945061] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.955979] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e in Status: IN_PROGRESS for 2s [ 972.099774] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-736 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.099774] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-736" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.100099] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-736" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.102204] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-736" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.102204] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.102204] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.102690] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.103016] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.103227] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.103495] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 972.104876] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 972.105036] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 972.105179] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 972.105369] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 972.105668] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 972.105861] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 972.154714] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 972.155015] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.049 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 972.155236] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 972.155488] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-736" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.159075] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-82fd7815-aa7f-400c-a2e6-688eef4b95cb taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.159075] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-82fd7815-aa7f-400c-a2e6-688eef4b95cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.159075] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-82fd7815-aa7f-400c-a2e6-688eef4b95cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.159075] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-82fd7815-aa7f-400c-a2e6-688eef4b95cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.159075] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82fd7815-aa7f-400c-a2e6-688eef4b95cb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.173475] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.173720] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.173812] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.174117] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.174235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.174455] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.174629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.174737] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.175053] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.175053] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.175132] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 already deleted. [ 972.175212] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.457207] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.457475] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.457475] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.457664] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.457879] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.457879] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f732d92a-92e7-4f0e-8801-62a1e2b456e4 is going to be deleted. [ 972.526244] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.526621] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.526621] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.526825] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.527100] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.527256] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f732d92a-92e7-4f0e-8801-62a1e2b456e4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.662120] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.662372] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.662372] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.662801] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.663015] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.663230] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 82fd7815-aa7f-400c-a2e6-688eef4b95cb not found, creating... [ 972.663604] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.663821] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.663979] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.664336] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.664630] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.664915] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.665209] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.665378] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.665668] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.665836] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.666055] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 82fd7815-aa7f-400c-a2e6-688eef4b95cb is going to be created. [ 972.688941] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.689216] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.689351] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.689620] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.689846] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.690091] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-82fd7815-aa7f-400c-a2e6-688eef4b95cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.348395] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: SUCCESS [ 973.348395] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.348395] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.348734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.348734] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.348734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.348848] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.348945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.349037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.349122] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.349220] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.353744] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d15cba36-9c0e-45f0-8225-a808a551bd40 in Status: SUCCESS [ 973.353931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.354242] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.354315] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.354493] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.354605] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.354672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.354820] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.354897] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.354989] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.355846] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.356018] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.356694] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.356802] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.356872] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.357034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.357963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.357963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.359104] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.361640] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.361640] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.361640] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.361640] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.361640] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.361933] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.361933] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.361933] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.373207] env[66994]: INFO networking_nsxv3.common.synchronization [req-cf5fd8b1-fc0a-467f-af7c-489a52063d93 req-998ca606-e7b9-47fa-930e-7b12cf7025ce service nova] Enqueued Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_rules [ 973.373291] env[66994]: INFO networking_nsxv3.common.synchronization [req-cf5fd8b1-fc0a-467f-af7c-489a52063d93 req-998ca606-e7b9-47fa-930e-7b12cf7025ce service nova] Enqueued Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_members [ 973.373466] env[66994]: INFO networking_nsxv3.common.synchronization [req-cf5fd8b1-fc0a-467f-af7c-489a52063d93 req-998ca606-e7b9-47fa-930e-7b12cf7025ce service nova] Enqueued Resource ID: 82fd7815-aa7f-400c-a2e6-688eef4b95cb with Priority: HIGHEST for action port [ 973.374109] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_rules [ 973.374318] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_members [ 973.374553] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82fd7815-aa7f-400c-a2e6-688eef4b95cb with Priority: HIGHEST for action port [ 973.374694] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88a75cae-9123-4d4d-9e51-add1196ab1f2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.374889] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.374889] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.375651] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.375734] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.377110] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a75cae-9123-4d4d-9e51-add1196ab1f2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.377203] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.377240] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.378281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.378281] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.378281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.378281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.378281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.378281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.378281] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.381463] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-82fd7815-aa7f-400c-a2e6-688eef4b95cb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.381463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82fd7815-aa7f-400c-a2e6-688eef4b95cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.381463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82fd7815-aa7f-400c-a2e6-688eef4b95cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.381463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82fd7815-aa7f-400c-a2e6-688eef4b95cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.381463] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82fd7815-aa7f-400c-a2e6-688eef4b95cb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.863355] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.863355] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.863355] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.865023] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.865853] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.882074] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a75cae-9123-4d4d-9e51-add1196ab1f2 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.882074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.882074] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.883442] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82fd7815-aa7f-400c-a2e6-688eef4b95cb with status ACTIVE [ 973.883685] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.884608] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.884608] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.884608] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.884608] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.884608] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.884608] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.884608] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.885124] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.885124] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.885124] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.885124] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.885124] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.887109] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.887109] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.887109] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82fd7815-aa7f-400c-a2e6-688eef4b95cb is going to be updated. [ 973.908745] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.909463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.909463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.909463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.909948] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.909948] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82fd7815-aa7f-400c-a2e6-688eef4b95cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.969082] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e in Status: SUCCESS [ 973.969403] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.969929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.970208] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.970435] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.970565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.970647] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.970901] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.971036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.971253] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.971380] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e351cb9-ed41-4a93-8257-1a5acb7b4f9e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.365240] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.367966] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d15cba36-9c0e-45f0-8225-a808a551bd40: rpc.has_security_group_logging(os_id): False [ 974.369052] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.387883] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.391630] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.391630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.391743] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.391916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.392073] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.394037] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.394037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.394037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.394037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.394037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.394037] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d15cba36-9c0e-45f0-8225-a808a551bd40 is going to be created. [ 974.462810] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.462991] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.463093] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.463741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.463741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.473948] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e351cb9-ed41-4a93-8257-1a5acb7b4f9e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.476340] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d15cba36-9c0e-45f0-8225-a808a551bd40 in Status: IN_PROGRESS for 2s [ 974.869292] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.869292] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.869474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.869539] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.869633] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.869738] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d88934f6-85c4-4f45-a1fc-042377e3901a is going to be updated. [ 974.872589] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.872739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.872804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.873017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.873108] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.873208] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d15cba36-9c0e-45f0-8225-a808a551bd40 is going to be updated. [ 974.890278] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.890446] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.890501] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.890717] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.890811] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.890909] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 is going to be created. [ 974.907147] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.907375] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.907375] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.907628] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.907902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.909854] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.909854] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.909854] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.910096] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.910196] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.920819] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: IN_PROGRESS for 2s [ 974.921553] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d15cba36-9c0e-45f0-8225-a808a551bd40 in Status: IN_PROGRESS for 2s [ 974.927230] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.927416] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.927478] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.927692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.927879] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.950416] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: UNINITIALIZED for 2s [ 974.975998] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e: rpc.has_security_group_logging(os_id): False [ 974.998784] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.999064] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.999121] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.999352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.999448] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.999706] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.999820] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.999876] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.000107] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.000107] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.000195] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e is going to be created. [ 975.092680] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.092680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.092680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.092680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.092680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.105484] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e in Status: IN_PROGRESS for 2s [ 976.261807] env[66994]: INFO networking_nsxv3.common.synchronization [req-922ca90a-02c9-45f4-a108-d04e2bd23252 req-ed5a935d-3b5a-41e4-b90f-7846bdb6f3bc tempest-ServerRescueNegativeTestJSON-420933347 tempest-ServerRescueNegativeTestJSON-420933347-project-member] Enqueued Resource ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 with Priority: HIGHEST for action security_group_members [ 976.263407] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 with Priority: HIGHEST for action security_group_members [ 976.263739] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e887c3d4-547e-480b-bd4c-f503fcb02ca5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.263865] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.263949] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.264200] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.264373] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.264473] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.264568] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.264757] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.264844] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.264936] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e887c3d4-547e-480b-bd4c-f503fcb02ca5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.492964] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d15cba36-9c0e-45f0-8225-a808a551bd40 in Status: SUCCESS [ 976.493608] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.493726] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.493997] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.494100] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.729582] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.729582] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-442" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.729891] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-442" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.730192] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-442" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.731592] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.731592] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.731592] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.731592] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.731592] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.731592] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 976.731592] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 976.732085] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 976.732085] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 976.732085] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 976.732085] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 976.732234] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 976.761734] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 976.761951] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 976.762083] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 976.762277] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-442" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.762665] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-a1b30c20-e30e-4ba9-9905-ec4c2175160a taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.762870] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-a1b30c20-e30e-4ba9-9905-ec4c2175160a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.762991] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-a1b30c20-e30e-4ba9-9905-ec4c2175160a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.763565] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-a1b30c20-e30e-4ba9-9905-ec4c2175160a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.763740] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1b30c20-e30e-4ba9-9905-ec4c2175160a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.767378] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.767648] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.767648] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.768405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.768405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.768405] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.768405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.768630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.768758] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.768967] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.769139] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 already deleted. [ 976.769266] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.933383] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: SUCCESS [ 976.933694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.933873] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.934134] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.934373] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.934489] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.934529] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.934682] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.934763] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.934856] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.936514] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d15cba36-9c0e-45f0-8225-a808a551bd40 in Status: SUCCESS [ 976.936720] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.936885] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.937108] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.937355] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.937426] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.937464] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.937583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.937662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.937761] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.963021] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: SUCCESS [ 976.963021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.963021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.963021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.963021] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.963021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.963021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.963021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.963021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.963021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.963021] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.997789] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d15cba36-9c0e-45f0-8225-a808a551bd40 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.998276] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.119416] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e in Status: SUCCESS [ 977.119571] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.266625] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.267021] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.267021] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.267234] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.267380] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.267574] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port a1b30c20-e30e-4ba9-9905-ec4c2175160a not found, creating... [ 977.268082] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.268397] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.268567] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.268832] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.269020] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.269340] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.269535] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.269692] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.269932] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.270110] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.270283] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: a1b30c20-e30e-4ba9-9905-ec4c2175160a is going to be created. [ 977.289754] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.289951] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.290097] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.290360] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.290583] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.290805] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-a1b30c20-e30e-4ba9-9905-ec4c2175160a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.439205] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.440491] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.466311] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.942703] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.944035] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.969482] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88a75cae-9123-4d4d-9e51-add1196ab1f2: rpc.has_security_group_logging(os_id): False [ 977.989380] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.989587] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.989677] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.989903] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.989991] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.990340] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.991100] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.991185] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.991357] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.992221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.992221] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 is going to be created. [ 978.011580] env[66994]: INFO networking_nsxv3.common.synchronization [req-922ca90a-02c9-45f4-a108-d04e2bd23252 req-f8f6235b-eafc-4b18-980b-732ddfc60856 service nova] Enqueued Resource ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 with Priority: HIGHEST for action security_group_rules [ 978.011823] env[66994]: INFO networking_nsxv3.common.synchronization [req-922ca90a-02c9-45f4-a108-d04e2bd23252 req-f8f6235b-eafc-4b18-980b-732ddfc60856 service nova] Enqueued Resource ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 with Priority: HIGHEST for action security_group_members [ 978.011910] env[66994]: INFO networking_nsxv3.common.synchronization [req-922ca90a-02c9-45f4-a108-d04e2bd23252 req-f8f6235b-eafc-4b18-980b-732ddfc60856 service nova] Enqueued Resource ID: a1b30c20-e30e-4ba9-9905-ec4c2175160a with Priority: HIGHEST for action port [ 978.012580] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 with Priority: HIGHEST for action security_group_rules [ 978.219570] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 with Priority: HIGHEST for action security_group_members [ 978.220045] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b30c20-e30e-4ba9-9905-ec4c2175160a with Priority: HIGHEST for action port [ 978.221950] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.222248] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.222397] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.222788] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.223157] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.224878] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e887c3d4-547e-480b-bd4c-f503fcb02ca5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.225132] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.225279] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.225616] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.225735] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e887c3d4-547e-480b-bd4c-f503fcb02ca5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.228429] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e887c3d4-547e-480b-bd4c-f503fcb02ca5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.228673] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.228799] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.229076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.229348] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.229540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.229671] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.229942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.230138] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.230326] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e887c3d4-547e-480b-bd4c-f503fcb02ca5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.231605] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1b30c20-e30e-4ba9-9905-ec4c2175160a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.231772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1b30c20-e30e-4ba9-9905-ec4c2175160a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.231882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1b30c20-e30e-4ba9-9905-ec4c2175160a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.232152] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1b30c20-e30e-4ba9-9905-ec4c2175160a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.232279] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1b30c20-e30e-4ba9-9905-ec4c2175160a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.246534] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: IN_PROGRESS for 2s [ 978.397994] env[66994]: INFO networking_nsxv3.common.synchronization [None req-c431399c-edc1-44c9-8cee-fe0de5daff35 None None] Enqueued Resource ID: 9a3ec30d-4eaa-4a2c-8888-c95c653e8bbb with Priority: HIGHEST for action port [ 978.397994] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a3ec30d-4eaa-4a2c-8888-c95c653e8bbb with Priority: HIGHEST for action port [ 978.398761] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a3ec30d-4eaa-4a2c-8888-c95c653e8bbb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.398971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a3ec30d-4eaa-4a2c-8888-c95c653e8bbb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.398971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a3ec30d-4eaa-4a2c-8888-c95c653e8bbb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.399546] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a3ec30d-4eaa-4a2c-8888-c95c653e8bbb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.399546] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a3ec30d-4eaa-4a2c-8888-c95c653e8bbb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.446494] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.446684] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.446684] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.446915] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.447015] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.447420] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d88934f6-85c4-4f45-a1fc-042377e3901a is going to be updated. [ 978.449471] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.449598] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.449656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.449834] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.449916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.450010] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d15cba36-9c0e-45f0-8225-a808a551bd40 is going to be updated. [ 978.482468] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.482691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.482691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.482901] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.483177] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.485430] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.485617] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.485702] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.485952] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.486178] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.500373] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: IN_PROGRESS for 2s [ 978.501780] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d15cba36-9c0e-45f0-8225-a808a551bd40 in Status: IN_PROGRESS for 2s [ 978.734425] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e887c3d4-547e-480b-bd4c-f503fcb02ca5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.735879] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.737201] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e887c3d4-547e-480b-bd4c-f503fcb02ca5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.738989] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1b30c20-e30e-4ba9-9905-ec4c2175160a with status ACTIVE [ 978.738989] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.738989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.738989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.738989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.739325] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.739613] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.739764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.739849] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.740062] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.740165] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.740386] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.740509] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.740587] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.740886] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.741012] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.741779] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1b30c20-e30e-4ba9-9905-ec4c2175160a is going to be updated. [ 978.768131] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.768267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.768362] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.769155] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.769155] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.769155] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1b30c20-e30e-4ba9-9905-ec4c2175160a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.902172] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a3ec30d-4eaa-4a2c-8888-c95c653e8bbb [ 978.902432] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.902572] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.902639] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.902970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.903038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.903112] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a3ec30d-4eaa-4a2c-8888-c95c653e8bbb already deleted. [ 978.903180] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a3ec30d-4eaa-4a2c-8888-c95c653e8bbb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.989959] env[66994]: INFO networking_nsxv3.common.synchronization [req-aada9f63-33e5-4743-99ca-3730bc1d1fc3 req-cf15e8ef-50c1-4758-928e-b3a30ef4a8c4 tempest-ServersTestJSON-587851554 tempest-ServersTestJSON-587851554-project-member] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 978.990560] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 978.990796] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.990929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.990985] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.991190] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.991352] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.991428] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.991494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.991636] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.991720] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.991958] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.244026] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e887c3d4-547e-480b-bd4c-f503fcb02ca5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.441057] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.441361] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.441410] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.441654] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.441904] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.444314] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.444440] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.444685] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.445294] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.445294] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 979.445294] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 979.445294] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 979.445844] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 979.445844] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 979.445844] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 979.445844] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 979.469853] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 979.470037] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 979.470160] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 979.470334] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.470675] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-7e32898c-84a2-449a-9aa7-c0be05bd2b53 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.470858] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-7e32898c-84a2-449a-9aa7-c0be05bd2b53" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.470975] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-7e32898c-84a2-449a-9aa7-c0be05bd2b53" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.471335] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-7e32898c-84a2-449a-9aa7-c0be05bd2b53" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.471473] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e32898c-84a2-449a-9aa7-c0be05bd2b53',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.494714] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.747929] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.747929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.747929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.747929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.747929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.747929] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 is going to be created. [ 979.775606] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.775805] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.775945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.776675] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.777622] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.788477] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 in Status: UNINITIALIZED for 2s [ 979.977261] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.981179] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.981179] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.981179] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.981179] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.981179] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 7e32898c-84a2-449a-9aa7-c0be05bd2b53 not found, creating... [ 979.981179] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.981179] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.981179] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.981179] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.981179] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.981577] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.981577] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.981577] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.981577] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.982066] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.982066] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 7e32898c-84a2-449a-9aa7-c0be05bd2b53 is going to be created. [ 979.997827] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.005273] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.005442] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.005669] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.005871] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.006153] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.006461] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-7e32898c-84a2-449a-9aa7-c0be05bd2b53" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.265882] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: SUCCESS [ 980.266247] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.500452] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.500855] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.500855] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.501547] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.501547] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.501547] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 980.522024] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d15cba36-9c0e-45f0-8225-a808a551bd40 in Status: SUCCESS [ 980.522024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.522024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.522024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.522024] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.522342] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.522342] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.522439] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.522491] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.522592] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.522671] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.524835] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: SUCCESS [ 980.525061] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.525177] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.525367] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.525539] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.525739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.525796] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.525905] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.525985] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.526084] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.526354] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.526354] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.526508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.526555] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.526670] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.526906] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.527078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.527589] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.527799] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.527799] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.528683] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.544456] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.544682] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.544682] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.544950] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.545143] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.556377] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 980.808421] env[66994]: INFO networking_nsxv3.common.synchronization [req-aada9f63-33e5-4743-99ca-3730bc1d1fc3 req-eea6f1de-78ac-4c37-b732-a892cf89efe4 service nova] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_rules [ 980.808594] env[66994]: INFO networking_nsxv3.common.synchronization [req-aada9f63-33e5-4743-99ca-3730bc1d1fc3 req-eea6f1de-78ac-4c37-b732-a892cf89efe4 service nova] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 980.808727] env[66994]: INFO networking_nsxv3.common.synchronization [req-aada9f63-33e5-4743-99ca-3730bc1d1fc3 req-eea6f1de-78ac-4c37-b732-a892cf89efe4 service nova] Enqueued Resource ID: 7e32898c-84a2-449a-9aa7-c0be05bd2b53 with Priority: HIGHEST for action port [ 980.809519] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_rules [ 980.809519] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 980.809519] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e32898c-84a2-449a-9aa7-c0be05bd2b53 with Priority: HIGHEST for action port [ 980.809755] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.809872] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.809987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.810146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.810241] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.811167] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.811276] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.811412] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e32898c-84a2-449a-9aa7-c0be05bd2b53 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.811506] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e32898c-84a2-449a-9aa7-c0be05bd2b53" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.811742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e32898c-84a2-449a-9aa7-c0be05bd2b53" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.811742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e32898c-84a2-449a-9aa7-c0be05bd2b53" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.811886] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e32898c-84a2-449a-9aa7-c0be05bd2b53',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.036103] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.036103] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d88934f6-85c4-4f45-a1fc-042377e3901a: rpc.has_security_group_logging(os_id): False [ 981.058153] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.058153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.058153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.058153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.058153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.058153] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.058153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.058153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.058153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.058153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.058153] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.058153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.058153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.058153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.058153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.058667] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.058667] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.058667] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.058899] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.059086] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.059258] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d88934f6-85c4-4f45-a1fc-042377e3901a is going to be updated. [ 981.174087] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.174087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.174087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.174087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.174087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.188904] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: IN_PROGRESS for 2s [ 981.231321] env[66994]: INFO networking_nsxv3.common.synchronization [None req-17a983f3-16eb-41ca-ae56-dd2b61f589c1 None None] Enqueued Resource ID: c6effb3e-2cec-4773-9231-636a2eb9a26c with Priority: HIGHEST for action port [ 981.232429] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6effb3e-2cec-4773-9231-636a2eb9a26c with Priority: HIGHEST for action port [ 981.233932] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6effb3e-2cec-4773-9231-636a2eb9a26c taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.237448] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6effb3e-2cec-4773-9231-636a2eb9a26c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.237448] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6effb3e-2cec-4773-9231-636a2eb9a26c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.237448] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6effb3e-2cec-4773-9231-636a2eb9a26c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.237448] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6effb3e-2cec-4773-9231-636a2eb9a26c',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.314034] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.314127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.314681] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e32898c-84a2-449a-9aa7-c0be05bd2b53 with status ACTIVE [ 981.314681] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.314681] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.314681] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.314907] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.314907] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.315858] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.315858] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.315858] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.315858] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.315858] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.315858] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.315858] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.315858] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.316177] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.316177] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.316177] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e32898c-84a2-449a-9aa7-c0be05bd2b53 is going to be updated. [ 981.347960] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.349176] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.349176] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.349176] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.349176] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.349176] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e32898c-84a2-449a-9aa7-c0be05bd2b53" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.537646] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d15cba36-9c0e-45f0-8225-a808a551bd40: rpc.has_security_group_logging(os_id): False [ 981.557521] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.558023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.558023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.558156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.558187] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.558717] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.558717] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.558717] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.558921] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.558921] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.559031] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d15cba36-9c0e-45f0-8225-a808a551bd40 is going to be updated. [ 981.630523] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.630704] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.630789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.631058] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.631228] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.643484] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d15cba36-9c0e-45f0-8225-a808a551bd40 in Status: IN_PROGRESS for 2s [ 981.741195] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c6effb3e-2cec-4773-9231-636a2eb9a26c [ 981.741445] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.741585] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.741654] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.741888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.741982] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.742095] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c6effb3e-2cec-4773-9231-636a2eb9a26c already deleted. [ 981.742181] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6effb3e-2cec-4773-9231-636a2eb9a26c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.798783] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 in Status: SUCCESS [ 981.799164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.799341] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.799560] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.799751] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.799869] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.799932] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.800102] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.800179] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.800262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.800349] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e887c3d4-547e-480b-bd4c-f503fcb02ca5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.302823] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e887c3d4-547e-480b-bd4c-f503fcb02ca5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.569578] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 982.569960] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.570037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.570220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.570440] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.570625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.570747] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.571048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.571048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.571157] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.806929] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e887c3d4-547e-480b-bd4c-f503fcb02ca5: rpc.has_security_group_logging(os_id): False [ 982.829792] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.829987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.830046] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.830226] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.830309] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.830584] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.830708] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.830770] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.830926] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.830994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.831371] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 is going to be created. [ 982.898170] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.898170] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.898170] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.898170] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.898170] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.909072] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 in Status: IN_PROGRESS for 2s [ 983.075846] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.207970] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: SUCCESS [ 983.208471] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.208471] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.208763] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.208846] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.578494] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.659279] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d15cba36-9c0e-45f0-8225-a808a551bd40 in Status: SUCCESS [ 983.659550] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.711728] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.711885] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.711963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.712335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.712545] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.712675] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.712754] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.712957] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.713075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.713231] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.713926] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.775245] env[66994]: INFO networking_nsxv3.common.synchronization [req-df295d08-9399-4aa4-a616-e723895595a0 req-5ee3ebbe-1744-45ae-a3be-29147f54e872 tempest-ServerActionsTestOtherB-1891732265 tempest-ServerActionsTestOtherB-1891732265-project-member] Enqueued Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_members [ 983.776027] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_members [ 983.776444] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.776619] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.776733] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.777012] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.777216] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.777332] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.777425] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.777650] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.777771] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.777900] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.081939] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.081939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.081939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.081939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.081939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.082184] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 984.110443] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.110905] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.111256] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.111556] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.111632] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.123388] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 984.217054] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.217054] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.217054] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.217281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.217874] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.217874] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.217874] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.217874] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.218112] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.218112] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.218172] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.218261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.218491] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.218491] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.218594] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.219508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.219508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.219508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.219508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.220252] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.220371] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.280501] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.280700] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.280762] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.280987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.305921] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.306210] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.306337] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.306405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.306717] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.306786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.306883] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e is going to be updated. [ 984.355261] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.355500] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.355500] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.355780] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.355930] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.368072] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: IN_PROGRESS for 2s [ 984.722605] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d88934f6-85c4-4f45-a1fc-042377e3901a: rpc.has_security_group_logging(os_id): False [ 984.740911] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.741071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.741154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.741363] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.741474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.741724] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.741885] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.742007] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.742265] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.742420] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.742565] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.742663] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.742724] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.742872] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.742934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.743234] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.743333] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.743392] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.743554] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.743646] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.743741] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d88934f6-85c4-4f45-a1fc-042377e3901a is going to be updated. [ 984.809052] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.809312] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.809387] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.809673] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.809868] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.825458] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: IN_PROGRESS for 2s [ 984.920787] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 in Status: SUCCESS [ 984.921098] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.135069] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 986.135427] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.135512] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.137310] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.137310] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.137310] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.137310] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.137310] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.137310] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.137310] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.137310] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.149399] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.149399] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-988" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.149399] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-988" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.149399] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-988" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.149903] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.150128] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.150251] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.150489] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.150662] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.150873] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 986.150990] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.151110] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.151216] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.151324] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 986.151492] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.151558] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.175972] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.175972] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 986.176249] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.176249] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-988" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.176535] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-bd7439df-d1c9-48bc-a885-d3243d84d319 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.177235] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-bd7439df-d1c9-48bc-a885-d3243d84d319" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.177235] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-bd7439df-d1c9-48bc-a885-d3243d84d319" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.177348] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-bd7439df-d1c9-48bc-a885-d3243d84d319" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.177630] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd7439df-d1c9-48bc-a885-d3243d84d319',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.378861] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: SUCCESS [ 986.379056] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e deletion is rescheduled due to dependency. [ 986.379185] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.640106] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.640538] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.640538] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.640662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.641629] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.641629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.641629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.641629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.641629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.641629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.641629] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.641629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.641629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.641994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.641994] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.641994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.642101] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.642180] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.642325] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.642325] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.642481] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.679831] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.680096] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.680250] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.680536] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.680693] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.680997] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.681168] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.681284] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.681506] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.681732] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.681996] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.682141] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.682253] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.682462] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.682594] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.682736] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: bd7439df-d1c9-48bc-a885-d3243d84d319 is going to be updated. [ 986.706120] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.706357] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.706482] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.706853] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.707091] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.707327] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-bd7439df-d1c9-48bc-a885-d3243d84d319" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.843768] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: SUCCESS [ 986.843922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.144811] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8: rpc.has_security_group_logging(os_id): False [ 987.164836] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.165040] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.165103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.165379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.187667] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.187667] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.187667] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.187667] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.187667] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.187667] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.188071] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.188071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.188071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.188071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.188216] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.188816] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.188816] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.188816] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.188816] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.188816] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.188816] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 987.272936] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.273191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.273191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.273387] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.273530] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.289425] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 987.450403] env[66994]: INFO networking_nsxv3.common.synchronization [req-7a3c2b8e-5a52-4530-a415-acf641864cb4 req-7bd09992-2f14-4596-9ecb-4fcad58f846f service nova] Enqueued Resource ID: 0023a3cd-aa32-4af2-a423-608695d50731 with Priority: HIGHEST for action security_group_rules [ 987.450775] env[66994]: INFO networking_nsxv3.common.synchronization [req-7a3c2b8e-5a52-4530-a415-acf641864cb4 req-7bd09992-2f14-4596-9ecb-4fcad58f846f service nova] Enqueued Resource ID: 0023a3cd-aa32-4af2-a423-608695d50731 with Priority: HIGHEST for action security_group_members [ 987.451059] env[66994]: INFO networking_nsxv3.common.synchronization [req-7a3c2b8e-5a52-4530-a415-acf641864cb4 req-7bd09992-2f14-4596-9ecb-4fcad58f846f service nova] Enqueued Resource ID: bd7439df-d1c9-48bc-a885-d3243d84d319 with Priority: HIGHEST for action port [ 987.451618] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0023a3cd-aa32-4af2-a423-608695d50731 with Priority: HIGHEST for action security_group_rules [ 987.451758] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0023a3cd-aa32-4af2-a423-608695d50731 with Priority: HIGHEST for action security_group_members [ 987.451858] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd7439df-d1c9-48bc-a885-d3243d84d319 with Priority: HIGHEST for action port [ 987.452167] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0023a3cd-aa32-4af2-a423-608695d50731 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.452293] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.452353] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.452552] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.452631] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0023a3cd-aa32-4af2-a423-608695d50731',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.453538] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-0023a3cd-aa32-4af2-a423-608695d50731 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.453650] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.453719] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.453892] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.454048] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.454176] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.454219] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.454328] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.454410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.454497] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0023a3cd-aa32-4af2-a423-608695d50731',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.456150] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd7439df-d1c9-48bc-a885-d3243d84d319 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.456150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd7439df-d1c9-48bc-a885-d3243d84d319" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.456150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd7439df-d1c9-48bc-a885-d3243d84d319" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.457527] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd7439df-d1c9-48bc-a885-d3243d84d319" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.457662] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd7439df-d1c9-48bc-a885-d3243d84d319',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.961042] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-0023a3cd-aa32-4af2-a423-608695d50731 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.961362] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.961415] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0023a3cd-aa32-4af2-a423-608695d50731',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.963432] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd7439df-d1c9-48bc-a885-d3243d84d319 with status ACTIVE [ 987.963654] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.963802] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.963886] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.964107] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.964194] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.964383] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.964478] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.964540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.964688] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.964761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.964938] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.965038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.967095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.967095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.967095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.967095] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd7439df-d1c9-48bc-a885-d3243d84d319 is going to be updated. [ 987.987835] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.988060] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.988060] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.988279] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.988414] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.988593] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd7439df-d1c9-48bc-a885-d3243d84d319" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.467529] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0023a3cd-aa32-4af2-a423-608695d50731',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.970511] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.970683] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.970818] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.970978] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.971094] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.971209] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0023a3cd-aa32-4af2-a423-608695d50731 is going to be updated. [ 989.002015] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.002212] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.002261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.002443] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.002587] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.013649] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0023a3cd-aa32-4af2-a423-608695d50731 in Status: IN_PROGRESS for 2s [ 989.313430] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 989.313649] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.024511] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0023a3cd-aa32-4af2-a423-608695d50731 in Status: SUCCESS [ 991.024941] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.024941] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.025150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.025379] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.025503] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.025570] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.025775] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.025907] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.026017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.026115] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0023a3cd-aa32-4af2-a423-608695d50731',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.529187] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0023a3cd-aa32-4af2-a423-608695d50731',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.031313] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0023a3cd-aa32-4af2-a423-608695d50731: rpc.has_security_group_logging(os_id): False [ 992.055355] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.055538] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.055691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.055989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.079165] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.082350] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.082350] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.082350] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.082350] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.082350] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.082350] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0023a3cd-aa32-4af2-a423-608695d50731 is going to be updated. [ 992.183115] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.183315] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.183443] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.183586] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.183751] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.207166] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0023a3cd-aa32-4af2-a423-608695d50731 in Status: IN_PROGRESS for 2s [ 992.452750] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 992.452750] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 994.224598] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0023a3cd-aa32-4af2-a423-608695d50731 in Status: SUCCESS [ 994.225025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.329950] env[66994]: INFO networking_nsxv3.common.synchronization [req-d599d41e-c36f-45d6-b7d5-239d25303b18 req-b5fe13f3-fe5b-4abf-9af6-1381768de77c tempest-ServersTestJSON-587851554 tempest-ServersTestJSON-587851554-project-member] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 996.330694] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 996.331063] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.331276] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.331276] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.331510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.331637] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.332033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.332128] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.332286] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.332386] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.332496] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.834644] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.337054] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.390327] env[66994]: INFO networking_nsxv3.common.synchronization [req-2ac8b088-690c-462a-8b75-e7e79f623809 req-d04f97ef-972c-4c5e-a3b4-58ad349072a3 tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 997.391453] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 997.391786] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.391912] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.391968] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.393088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.393088] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.393088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.393088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.393088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.393088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.393088] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.803217] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-475 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.803482] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-475" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.803592] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-475" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.803880] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-475" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.804217] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.804417] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.804613] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.804928] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.806203] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.806203] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 997.806203] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 997.806203] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 997.806203] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 997.806203] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 997.806448] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 997.806448] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 997.833088] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 997.833088] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 997.833088] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 997.833088] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-475" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.833088] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-68d450c3-2cc8-436a-9c92-2fcf52368e7c taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.833088] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-68d450c3-2cc8-436a-9c92-2fcf52368e7c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.833088] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-68d450c3-2cc8-436a-9c92-2fcf52368e7c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.833088] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-68d450c3-2cc8-436a-9c92-2fcf52368e7c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.833695] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68d450c3-2cc8-436a-9c92-2fcf52368e7c',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.844383] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.844383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.844383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.844383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.844383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.844383] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 997.879281] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.879281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.879281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.879281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.879281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.889942] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 997.895084] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.338049] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.338631] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.338631] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.338790] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.338938] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.339107] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 68d450c3-2cc8-436a-9c92-2fcf52368e7c not found, creating... [ 998.339393] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.339587] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.339681] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.339927] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.340085] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.340397] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.340549] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.340664] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.340945] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.341118] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.341253] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 68d450c3-2cc8-436a-9c92-2fcf52368e7c is going to be created. [ 998.379245] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.379484] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.379597] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.379864] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.380120] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.380344] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-68d450c3-2cc8-436a-9c92-2fcf52368e7c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.397640] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.899932] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.900212] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.900325] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.900631] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.900778] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.900957] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d88934f6-85c4-4f45-a1fc-042377e3901a is going to be updated. [ 998.935014] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.935205] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.935278] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.935499] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.935677] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.946361] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: IN_PROGRESS for 2s [ 999.081187] env[66994]: INFO networking_nsxv3.common.synchronization [req-2ac8b088-690c-462a-8b75-e7e79f623809 req-00ff7c05-b6b9-48d0-823d-af8f8173d61a service nova] Enqueued Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_rules [ 999.081373] env[66994]: INFO networking_nsxv3.common.synchronization [req-2ac8b088-690c-462a-8b75-e7e79f623809 req-00ff7c05-b6b9-48d0-823d-af8f8173d61a service nova] Enqueued Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 999.081508] env[66994]: INFO networking_nsxv3.common.synchronization [req-2ac8b088-690c-462a-8b75-e7e79f623809 req-00ff7c05-b6b9-48d0-823d-af8f8173d61a service nova] Enqueued Resource ID: 68d450c3-2cc8-436a-9c92-2fcf52368e7c with Priority: HIGHEST for action port [ 999.082080] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_rules [ 999.082222] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 999.082319] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68d450c3-2cc8-436a-9c92-2fcf52368e7c with Priority: HIGHEST for action port [ 999.082640] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.083553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.083703] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.083950] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.084036] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.085562] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.085637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.085886] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-68d450c3-2cc8-436a-9c92-2fcf52368e7c taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.085993] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68d450c3-2cc8-436a-9c92-2fcf52368e7c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.087436] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68d450c3-2cc8-436a-9c92-2fcf52368e7c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.087436] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68d450c3-2cc8-436a-9c92-2fcf52368e7c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.087436] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68d450c3-2cc8-436a-9c92-2fcf52368e7c',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.590719] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.590719] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.590719] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68d450c3-2cc8-436a-9c92-2fcf52368e7c with status ACTIVE [ 999.590719] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.590719] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.590719] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.590719] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.590719] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.590719] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.590719] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.590719] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.590719] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.590719] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.590719] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.591514] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.591514] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.591514] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.591514] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.591514] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68d450c3-2cc8-436a-9c92-2fcf52368e7c is going to be updated. [ 999.615558] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.615794] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.615794] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.616261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.616261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.616408] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68d450c3-2cc8-436a-9c92-2fcf52368e7c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.901360] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 999.901661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.908685] env[66994]: INFO networking_nsxv3.common.synchronization [req-9cd8cf65-2f21-4643-88aa-78866c119489 req-f851d430-383f-4695-a49e-ea81127f617f tempest-ImagesTestJSON-691407333 tempest-ImagesTestJSON-691407333-project-member] Enqueued Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 999.909297] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 999.909622] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.909742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.909809] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.910778] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.911996] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.912144] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.912216] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.912429] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.912525] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.912626] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.186874] env[66994]: INFO networking_nsxv3.common.synchronization [req-13b89aa0-9260-4602-a1e4-fc49af3668c8 req-89f27a26-d826-4989-bf6e-927e254fb9c4 tempest-ServersWithSpecificFlavorTestJSON-500627254 tempest-ServersWithSpecificFlavorTestJSON-500627254-project-member] Enqueued Resource ID: a6612b52-6412-47ab-8918-14b6b8bca0cb with Priority: HIGHEST for action security_group_members [ 1000.188978] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6612b52-6412-47ab-8918-14b6b8bca0cb with Priority: HIGHEST for action security_group_members [ 1000.192463] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6612b52-6412-47ab-8918-14b6b8bca0cb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.192463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.192463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.192463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.192463] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.192463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.192463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.193274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.193583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.193959] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6612b52-6412-47ab-8918-14b6b8bca0cb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.285545] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-744 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.285763] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-744" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.286017] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-744" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.286479] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-744" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.286622] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.286787] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.286903] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.287152] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.287281] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.288265] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1000.288345] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1000.288469] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1000.288630] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1000.288760] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1000.288870] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1000.289035] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1000.314887] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1000.315081] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1000.315237] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1000.315439] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-744" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.315820] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-46414a3f-f505-4d52-9e03-9a08a79a6f4f taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.316043] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-46414a3f-f505-4d52-9e03-9a08a79a6f4f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.316191] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-46414a3f-f505-4d52-9e03-9a08a79a6f4f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.316552] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-46414a3f-f505-4d52-9e03-9a08a79a6f4f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.316716] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46414a3f-f505-4d52-9e03-9a08a79a6f4f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.416479] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.698320] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.698651] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.698651] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.698815] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.725023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.725023] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.725023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.725023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.725023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.725023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.725023] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6612b52-6412-47ab-8918-14b6b8bca0cb is going to be updated. [ 1000.758302] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.758302] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.758302] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.758302] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.758302] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.770443] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6612b52-6412-47ab-8918-14b6b8bca0cb in Status: IN_PROGRESS for 2s [ 1000.820158] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.820490] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.820646] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.820952] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.821125] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.821685] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 46414a3f-f505-4d52-9e03-9a08a79a6f4f not found, creating... [ 1000.821685] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.822012] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.822012] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.822224] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.822369] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.823033] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.823033] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.823033] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.823205] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.823374] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.823448] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 46414a3f-f505-4d52-9e03-9a08a79a6f4f is going to be created. [ 1000.847755] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.847755] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.847755] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.847755] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.848132] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.848240] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-46414a3f-f505-4d52-9e03-9a08a79a6f4f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.918197] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.960120] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: SUCCESS [ 1000.960395] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.960617] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.960942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.961224] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.961379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.961476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.961735] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.961866] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.961973] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.423084] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.423735] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.423735] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.423735] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.423735] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.423735] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e is going to be updated. [ 1001.458257] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.458429] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.458491] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.458679] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.458827] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.469017] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: IN_PROGRESS for 2s [ 1001.469304] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.579943] env[66994]: INFO networking_nsxv3.common.synchronization [req-9cd8cf65-2f21-4643-88aa-78866c119489 req-e0e45493-37e7-4972-9308-a2545ba98acf service nova] Enqueued Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_rules [ 1001.580234] env[66994]: INFO networking_nsxv3.common.synchronization [req-9cd8cf65-2f21-4643-88aa-78866c119489 req-e0e45493-37e7-4972-9308-a2545ba98acf service nova] Enqueued Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 1001.580408] env[66994]: INFO networking_nsxv3.common.synchronization [req-9cd8cf65-2f21-4643-88aa-78866c119489 req-e0e45493-37e7-4972-9308-a2545ba98acf service nova] Enqueued Resource ID: 46414a3f-f505-4d52-9e03-9a08a79a6f4f with Priority: HIGHEST for action port [ 1001.580998] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_rules [ 1001.581169] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 1001.581287] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46414a3f-f505-4d52-9e03-9a08a79a6f4f with Priority: HIGHEST for action port [ 1001.581622] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.581781] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.581859] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.582113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.582232] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.583090] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.583185] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.583386] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-46414a3f-f505-4d52-9e03-9a08a79a6f4f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.583483] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46414a3f-f505-4d52-9e03-9a08a79a6f4f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.583946] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46414a3f-f505-4d52-9e03-9a08a79a6f4f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.583946] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46414a3f-f505-4d52-9e03-9a08a79a6f4f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.583946] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46414a3f-f505-4d52-9e03-9a08a79a6f4f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.831575] env[66994]: INFO networking_nsxv3.common.synchronization [req-9e8e4066-45e7-4466-8a3c-125ddc6cff97 req-d584c6fe-b50a-4fca-9bf0-a2f74d41d3ed tempest-MigrationsAdminTest-2127426748 tempest-MigrationsAdminTest-2127426748-project-member] Enqueued Resource ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d with Priority: HIGHEST for action security_group_members [ 1001.832138] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d with Priority: HIGHEST for action security_group_members [ 1001.832710] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.832710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.832710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.833094] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.833094] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.833235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.833278] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.833441] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.833536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.833629] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.971483] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.087825] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.087825] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.087825] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46414a3f-f505-4d52-9e03-9a08a79a6f4f with status ACTIVE [ 1002.087825] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.087825] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.087825] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.087825] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.088395] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.088395] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.088395] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.088395] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.088395] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.088575] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.088611] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.089067] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.089067] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.089067] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.089067] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.089067] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46414a3f-f505-4d52-9e03-9a08a79a6f4f is going to be updated. [ 1002.119088] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.119088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.119088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.119368] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.119368] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.119664] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46414a3f-f505-4d52-9e03-9a08a79a6f4f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.336439] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.474544] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.474709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.474806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.474969] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.475077] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.475178] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d88934f6-85c4-4f45-a1fc-042377e3901a is going to be updated. [ 1002.511898] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.512097] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.512163] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.512382] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.512536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.524184] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: IN_PROGRESS for 2s [ 1002.552814] env[66994]: INFO networking_nsxv3.common.synchronization [req-887e34de-ae85-4f58-ab81-b5a186b643ed req-9cd88c36-e282-4bde-8cc7-1fa59c9a9a38 tempest-DeleteServersTestJSON-15988793 tempest-DeleteServersTestJSON-15988793-project-member] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1002.552814] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1002.553389] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.553389] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.553389] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.553389] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.554078] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.554078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.554078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.554078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.554078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.554314] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.784080] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6612b52-6412-47ab-8918-14b6b8bca0cb in Status: SUCCESS [ 1002.784273] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6612b52-6412-47ab-8918-14b6b8bca0cb deletion is rescheduled due to dependency. [ 1002.784369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.838815] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.925223] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-160 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.925408] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.925527] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.925913] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.928322] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.928534] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.928664] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.928915] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.929122] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.929373] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1002.929489] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1002.929708] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1002.929708] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1002.929824] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1002.929898] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1002.930048] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1002.949585] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1002.949760] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1002.949900] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1002.950094] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.950534] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-525672c0-f0a9-4bbd-8853-582404f03427 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.950733] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-525672c0-f0a9-4bbd-8853-582404f03427" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.950859] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-525672c0-f0a9-4bbd-8853-582404f03427" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.951193] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-525672c0-f0a9-4bbd-8853-582404f03427" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.951337] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('525672c0-f0a9-4bbd-8853-582404f03427',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.056127] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.056607] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.056607] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.056607] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.056900] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.056900] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.057079] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.057319] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.057572] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.058936] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.059029] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 already deleted. [ 1003.059122] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.341377] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.341541] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.341661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.341816] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.341902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.342010] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d is going to be updated. [ 1003.380391] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.380686] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.380686] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.380915] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.380915] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.395183] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d in Status: IN_PROGRESS for 2s [ 1003.454228] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.454666] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.454913] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.455390] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.455669] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.456230] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 525672c0-f0a9-4bbd-8853-582404f03427 not found, creating... [ 1003.456475] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.456774] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.456996] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.457425] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.457666] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.458228] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.458547] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.458776] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.459190] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.459456] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.459704] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 525672c0-f0a9-4bbd-8853-582404f03427 is going to be created. [ 1003.482773] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: SUCCESS [ 1003.483024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.483232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.483576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.483939] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.484125] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.484284] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.484397] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.484486] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.484594] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.487257] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.487465] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.487638] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.487829] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.488229] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.488310] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-525672c0-f0a9-4bbd-8853-582404f03427" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.987276] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.200885] env[66994]: INFO networking_nsxv3.common.synchronization [req-887e34de-ae85-4f58-ab81-b5a186b643ed req-51c522cd-e5e2-49b4-9817-c5f95da0d724 service nova] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_rules [ 1004.200885] env[66994]: INFO networking_nsxv3.common.synchronization [req-887e34de-ae85-4f58-ab81-b5a186b643ed req-51c522cd-e5e2-49b4-9817-c5f95da0d724 service nova] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1004.200885] env[66994]: INFO networking_nsxv3.common.synchronization [req-887e34de-ae85-4f58-ab81-b5a186b643ed req-51c522cd-e5e2-49b4-9817-c5f95da0d724 service nova] Enqueued Resource ID: 525672c0-f0a9-4bbd-8853-582404f03427 with Priority: HIGHEST for action port [ 1004.200885] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_rules [ 1004.200885] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1004.200885] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 525672c0-f0a9-4bbd-8853-582404f03427 with Priority: HIGHEST for action port [ 1004.201573] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.201573] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.201573] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.201573] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.201573] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.202597] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.202676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.205129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.205129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.205129] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.205129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.205129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.205129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.205129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.205129] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.205129] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-525672c0-f0a9-4bbd-8853-582404f03427 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.205129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-525672c0-f0a9-4bbd-8853-582404f03427" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.205129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-525672c0-f0a9-4bbd-8853-582404f03427" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.205129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-525672c0-f0a9-4bbd-8853-582404f03427" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.205129] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('525672c0-f0a9-4bbd-8853-582404f03427',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.491202] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.534046] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: SUCCESS [ 1004.534297] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.534547] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.534826] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.535127] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.535305] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.535375] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.535536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.535620] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.535708] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.535953] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.705827] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.706947] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.707086] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.709689] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 525672c0-f0a9-4bbd-8853-582404f03427 with status ACTIVE [ 1004.709871] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.709987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.710093] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.710277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.710362] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.710530] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.710679] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.710793] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.710912] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.710981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.711203] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.711291] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.711417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.711500] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.711573] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.711670] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 525672c0-f0a9-4bbd-8853-582404f03427 is going to be updated. [ 1004.732755] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.732951] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.732951] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.733182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.733319] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.733477] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-525672c0-f0a9-4bbd-8853-582404f03427" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.995308] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.995586] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.995628] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.998709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.998709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.998709] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e is going to be updated. [ 1005.039987] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.040201] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.040357] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.040454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.040620] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.040720] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.040827] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.040928] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.041029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.041117] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.041320] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.041428] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.041484] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.041631] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.041768] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.041860] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.041912] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.042068] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.042162] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.042213] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.042305] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.049262] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.049262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.049262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.049262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.049262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.059240] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: IN_PROGRESS for 2s [ 1005.210320] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.404966] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d in Status: SUCCESS [ 1005.404966] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.546398] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d88934f6-85c4-4f45-a1fc-042377e3901a: rpc.has_security_group_logging(os_id): False [ 1005.568401] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.568565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.568565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.569417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.569417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.569417] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.569417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.569417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.569417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.569417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.569712] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.569712] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.569712] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.569969] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.570082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.570271] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.570364] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.570425] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.570561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.570655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.570717] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d88934f6-85c4-4f45-a1fc-042377e3901a is going to be updated. [ 1005.655639] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.655836] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.655924] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.656426] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.656426] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.673622] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: IN_PROGRESS for 2s [ 1005.712971] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.713095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.713167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.713521] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.713691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.713862] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be created. [ 1005.729201] env[66994]: INFO networking_nsxv3.common.synchronization [None req-ad19109c-8538-47d2-9277-7aa7a4a02fb1 tempest-ServerDiskConfigTestJSON-2121377508 tempest-ServerDiskConfigTestJSON-2121377508-project-member] Enqueued Resource ID: da799a0b-9079-4d29-b1b2-f700722b1920 with Priority: HIGHEST for action security_group_rules [ 1005.729851] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da799a0b-9079-4d29-b1b2-f700722b1920 with Priority: HIGHEST for action security_group_rules [ 1005.730380] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da799a0b-9079-4d29-b1b2-f700722b1920 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.730588] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da799a0b-9079-4d29-b1b2-f700722b1920" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.730676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da799a0b-9079-4d29-b1b2-f700722b1920" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.730984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da799a0b-9079-4d29-b1b2-f700722b1920" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.731131] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da799a0b-9079-4d29-b1b2-f700722b1920',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.738738] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.738898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.739095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.739310] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.739477] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.755126] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: UNINITIALIZED for 2s [ 1005.857384] env[66994]: INFO networking_nsxv3.common.synchronization [None req-8a3fd50e-202a-4fb8-8874-b292819a7e92 tempest-ServerDiskConfigTestJSON-2121377508 tempest-ServerDiskConfigTestJSON-2121377508-project-member] Enqueued Resource ID: da799a0b-9079-4d29-b1b2-f700722b1920 with Priority: HIGHEST for action security_group_rules [ 1005.858258] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da799a0b-9079-4d29-b1b2-f700722b1920 with Priority: HIGHEST for action security_group_rules [ 1005.858258] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da799a0b-9079-4d29-b1b2-f700722b1920 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.858437] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da799a0b-9079-4d29-b1b2-f700722b1920" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.204111] env[66994]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1006.204495] env[66994]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1006.256394] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.256394] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.257050] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.257050] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.257050] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.257207] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da799a0b-9079-4d29-b1b2-f700722b1920 already deleted. [ 1006.257277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da799a0b-9079-4d29-b1b2-f700722b1920" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.258017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da799a0b-9079-4d29-b1b2-f700722b1920" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.258380] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da799a0b-9079-4d29-b1b2-f700722b1920" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.258436] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da799a0b-9079-4d29-b1b2-f700722b1920',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.781672] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.781796] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.781836] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.782387] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.782387] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.782387] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da799a0b-9079-4d29-b1b2-f700722b1920 already deleted. [ 1006.782387] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da799a0b-9079-4d29-b1b2-f700722b1920" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.071991] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: SUCCESS [ 1007.072322] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.072590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.072832] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.073119] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.073272] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.073355] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.073571] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.073687] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.074036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.074211] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.576728] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.577136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.577136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.577136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.577301] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.577399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.577462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.577634] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.577725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.577833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.577984] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.578119] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.578208] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.578321] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.578472] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.578562] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.578636] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.579179] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.579260] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.579348] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.579455] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.692389] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: SUCCESS [ 1007.692389] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.766127] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: SUCCESS [ 1007.766357] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.766510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.766784] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.766956] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.767114] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.767114] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.767857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.767857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.767857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.767857] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.082224] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88bd36a2-b7c7-405c-ba4b-c36eb190f52e: rpc.has_security_group_logging(os_id): False [ 1008.104413] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.104559] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.104559] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.105578] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.118257] env[66994]: INFO networking_nsxv3.common.synchronization [req-becdef93-a417-4a49-92ee-41bf66af8c23 req-66a35736-142e-41fa-a4b6-94eb31e42dab tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 1008.118448] env[66994]: INFO networking_nsxv3.common.synchronization [req-becdef93-a417-4a49-92ee-41bf66af8c23 req-66a35736-142e-41fa-a4b6-94eb31e42dab tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a with Priority: HIGHEST for action security_group_members [ 1008.118997] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 1008.119138] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a with Priority: HIGHEST for action security_group_members [ 1008.119417] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.119543] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.120803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.120803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.120803] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.120803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.120803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.120803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.120803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.120803] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.121495] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-addf6e3f-5f8b-4dab-9993-c2789c9f491a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.121495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.121495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.121679] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.121838] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.121926] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.121985] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.122141] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.122220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.122314] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('addf6e3f-5f8b-4dab-9993-c2789c9f491a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.125501] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.125744] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.126141] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.126317] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.126427] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.126508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.126733] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.126831] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.126913] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.127075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.127177] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.127331] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.127423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.127482] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.127618] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.127690] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.127778] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e is going to be updated. [ 1008.174014] env[66994]: INFO networking_nsxv3.common.synchronization [req-becdef93-a417-4a49-92ee-41bf66af8c23 req-66a35736-142e-41fa-a4b6-94eb31e42dab tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a with Priority: HIGHEST for action security_group_rules [ 1008.174209] env[66994]: INFO networking_nsxv3.common.synchronization [req-becdef93-a417-4a49-92ee-41bf66af8c23 req-66a35736-142e-41fa-a4b6-94eb31e42dab tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a with Priority: HIGHEST for action security_group_members [ 1008.174346] env[66994]: INFO networking_nsxv3.common.synchronization [req-becdef93-a417-4a49-92ee-41bf66af8c23 req-66a35736-142e-41fa-a4b6-94eb31e42dab tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_rules [ 1008.174472] env[66994]: INFO networking_nsxv3.common.synchronization [req-becdef93-a417-4a49-92ee-41bf66af8c23 req-66a35736-142e-41fa-a4b6-94eb31e42dab tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 1008.174919] env[66994]: INFO networking_nsxv3.common.synchronization [req-becdef93-a417-4a49-92ee-41bf66af8c23 req-66a35736-142e-41fa-a4b6-94eb31e42dab tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: 68d450c3-2cc8-436a-9c92-2fcf52368e7c with Priority: HIGHEST for action port [ 1008.175510] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a with Priority: HIGHEST for action security_group_rules [ 1008.175663] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_rules [ 1008.175814] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68d450c3-2cc8-436a-9c92-2fcf52368e7c with Priority: HIGHEST for action port [ 1008.175879] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a with Priority: HIGHEST for action security_group_members [ 1008.175968] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 1008.176271] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-addf6e3f-5f8b-4dab-9993-c2789c9f491a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.176408] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.176452] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.176701] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.176790] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('addf6e3f-5f8b-4dab-9993-c2789c9f491a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.177796] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.177894] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.177894] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.178088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.178172] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.179815] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-68d450c3-2cc8-436a-9c92-2fcf52368e7c taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.179997] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68d450c3-2cc8-436a-9c92-2fcf52368e7c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.180092] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68d450c3-2cc8-436a-9c92-2fcf52368e7c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.180278] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68d450c3-2cc8-436a-9c92-2fcf52368e7c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.180357] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68d450c3-2cc8-436a-9c92-2fcf52368e7c',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.182944] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-addf6e3f-5f8b-4dab-9993-c2789c9f491a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.182944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.182944] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.183079] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.203671] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.203916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.203979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.204213] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.204368] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.221707] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: IN_PROGRESS for 2s [ 1008.269618] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.269820] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.269882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.270175] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.270357] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.270476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.270576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.270845] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.270954] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.271295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.271295] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.271295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.271596] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.271596] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.271718] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.271981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.271981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.272136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.272186] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.272394] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.272648] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.624288] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.625581] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('addf6e3f-5f8b-4dab-9993-c2789c9f491a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.684576] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-addf6e3f-5f8b-4dab-9993-c2789c9f491a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.684794] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.685062] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.685231] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.685453] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68d450c3-2cc8-436a-9c92-2fcf52368e7c with status ACTIVE [ 1008.685624] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.685864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.685941] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.686250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.686453] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.686665] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.686774] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.686854] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.687050] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.687197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.687564] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.687740] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.687808] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.687986] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.688065] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.688160] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68d450c3-2cc8-436a-9c92-2fcf52368e7c is going to be updated. [ 1008.713771] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.713984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.714088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.714305] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.714452] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.714749] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68d450c3-2cc8-436a-9c92-2fcf52368e7c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.775101] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0030483-0783-4db3-971a-f3155da229b7: rpc.has_security_group_logging(os_id): False [ 1008.796930] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.797115] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.797195] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.797495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.797623] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.797883] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.798051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.798225] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.798439] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.798527] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.798755] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.798956] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.798956] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.799127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.799237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.799871] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.799871] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.799871] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.799871] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.799871] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.800139] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be created. [ 1008.904490] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.904720] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.904720] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.905057] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.905264] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.923735] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: IN_PROGRESS for 2s [ 1009.128036] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.129253] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('addf6e3f-5f8b-4dab-9993-c2789c9f491a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.630930] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.631449] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.631449] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.631562] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.631733] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.631787] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d88934f6-85c4-4f45-a1fc-042377e3901a is going to be updated. [ 1009.633574] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.633809] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.633923] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.634200] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.634342] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.634480] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a is going to be created. [ 1009.677226] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.677438] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.677438] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.678953] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.678953] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.714386] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.714386] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.714386] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.714731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.714844] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.716981] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a in Status: UNINITIALIZED for 2s [ 1009.727322] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: IN_PROGRESS for 2s [ 1010.238995] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: SUCCESS [ 1010.239338] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.340337] env[66994]: INFO networking_nsxv3.common.synchronization [req-be252286-8975-4de1-84eb-b92dc48842c1 req-7c45d0f5-9d95-4d7e-b092-8fde11932c4a tempest-ServerDiskConfigTestJSON-2121377508 tempest-ServerDiskConfigTestJSON-2121377508-project-member] Enqueued Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 1010.340918] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 1010.341665] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.341791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.341835] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.342057] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.342446] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.343055] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.343055] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.343055] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.343266] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.343266] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.841450] env[66994]: INFO networking_nsxv3.common.synchronization [req-9986dec6-afbe-484e-861d-63f8dfa3c80e req-37c0f775-bffe-49fd-b1d7-2dc73013f037 tempest-ServerActionsTestOtherB-1891732265 tempest-ServerActionsTestOtherB-1891732265-project-member] Enqueued Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_members [ 1010.842099] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_members [ 1010.842522] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.842728] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.842728] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.843258] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.843542] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.843633] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.843729] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.844130] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.844130] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.844512] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.846491] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.846690] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.846853] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.848590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.871059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.871364] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.871486] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.871601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.872253] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.872253] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.872253] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 is going to be updated. [ 1010.904510] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.904510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.904716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.905905] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.905905] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.917553] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: IN_PROGRESS for 2s [ 1010.936589] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: SUCCESS [ 1010.939016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.318450] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-729 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.320194] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-729" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.320194] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-729" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.321671] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-729" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.321671] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.321671] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.322187] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.322627] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.322949] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.323481] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.324233] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1011.324477] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1011.324662] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1011.324837] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.325025] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1011.325242] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1011.330289] env[66994]: INFO networking_nsxv3.common.synchronization [req-bb563e61-8009-4581-bf2f-fb0e6ea628df req-84b072e0-eab5-4be2-afe5-b6db6a0497d3 tempest-MigrationsAdminTest-2127426748 tempest-MigrationsAdminTest-2127426748-project-member] Enqueued Resource ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d with Priority: HIGHEST for action security_group_members [ 1011.330727] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d with Priority: HIGHEST for action security_group_members [ 1011.331355] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.331562] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.331665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.331929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.332146] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.335028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.335028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.335028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.335028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.335028] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.349993] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.350220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.350288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.350527] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.350689] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.350980] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.351226] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.351378] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.355066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.355066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.355066] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e is going to be updated. [ 1011.381481] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1011.381716] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.056 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1011.381813] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1011.382107] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-729" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.382355] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-8c983058-7059-4023-a9c3-9fd9c0a72794 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.382551] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-8c983058-7059-4023-a9c3-9fd9c0a72794" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.382671] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-8c983058-7059-4023-a9c3-9fd9c0a72794" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.383038] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-8c983058-7059-4023-a9c3-9fd9c0a72794" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.383201] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c983058-7059-4023-a9c3-9fd9c0a72794',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.417688] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.417971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.417971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.420518] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.420518] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.433216] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: IN_PROGRESS for 2s [ 1011.695285] env[66994]: INFO networking_nsxv3.common.synchronization [req-97caaedc-9292-4e41-a553-a8adfaab8a2c req-b127f7bf-e710-4ea7-a1e6-dad61159efe1 tempest-ServersTestJSON-587851554 tempest-ServersTestJSON-587851554-project-member] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 1011.695937] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 1011.696339] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.696471] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.696541] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.696746] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.696920] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.697095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.697244] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.697416] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.697504] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.697598] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.728159] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a in Status: SUCCESS [ 1011.728434] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.731400] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.732483] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.732667] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.732876] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.733051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.733304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.733465] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.733643] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('addf6e3f-5f8b-4dab-9993-c2789c9f491a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.744150] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: SUCCESS [ 1011.744484] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.745116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.745455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.745754] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.745954] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.746099] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.746372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.746511] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.746666] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.834695] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.834910] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.834910] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.835187] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.858764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.859086] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.859227] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.859304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.859988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.859988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.859988] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d is going to be updated. [ 1011.886298] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.886545] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.886673] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.887014] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.887186] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.887347] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 8c983058-7059-4023-a9c3-9fd9c0a72794 not found, creating... [ 1011.887622] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.887784] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.887899] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.888214] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.888365] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.888655] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.888812] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.888927] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.889161] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.889301] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.889446] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 8c983058-7059-4023-a9c3-9fd9c0a72794 is going to be created. [ 1011.894249] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.894402] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.894460] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.894659] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.894801] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.907740] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d in Status: IN_PROGRESS for 2s [ 1011.913272] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.913492] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.913612] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.913989] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.914237] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.914476] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-8c983058-7059-4023-a9c3-9fd9c0a72794" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.200278] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.236699] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('addf6e3f-5f8b-4dab-9993-c2789c9f491a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.248925] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.298259] env[66994]: INFO networking_nsxv3.common.synchronization [req-254c6f37-0e6f-4a84-b10f-22bd50cf46e4 req-c5453bdb-e28a-462f-8250-a103e5577ddd tempest-ServersTestFqdnHostnames-1753183055 tempest-ServersTestFqdnHostnames-1753183055-project-member] Enqueued Resource ID: c0f823fa-9f2d-40f7-9630-8dee9229983a with Priority: HIGHEST for action security_group_members [ 1012.298963] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f823fa-9f2d-40f7-9630-8dee9229983a with Priority: HIGHEST for action security_group_members [ 1012.299365] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0f823fa-9f2d-40f7-9630-8dee9229983a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.299503] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.299567] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.299790] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.299935] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.300052] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.300102] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.300263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.300333] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.300419] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0f823fa-9f2d-40f7-9630-8dee9229983a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.678347] env[66994]: INFO networking_nsxv3.common.synchronization [req-9986dec6-afbe-484e-861d-63f8dfa3c80e req-46e200ac-b0ea-4756-954a-f49f830f72bf service nova] Enqueued Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_rules [ 1012.678548] env[66994]: INFO networking_nsxv3.common.synchronization [req-9986dec6-afbe-484e-861d-63f8dfa3c80e req-46e200ac-b0ea-4756-954a-f49f830f72bf service nova] Enqueued Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_members [ 1012.678754] env[66994]: INFO networking_nsxv3.common.synchronization [req-9986dec6-afbe-484e-861d-63f8dfa3c80e req-46e200ac-b0ea-4756-954a-f49f830f72bf service nova] Enqueued Resource ID: 8c983058-7059-4023-a9c3-9fd9c0a72794 with Priority: HIGHEST for action port [ 1012.679498] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_rules [ 1012.679498] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_members [ 1012.679621] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c983058-7059-4023-a9c3-9fd9c0a72794 with Priority: HIGHEST for action port [ 1012.679888] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.680028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.680251] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.680406] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.680453] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.682833] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.682833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.682833] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c983058-7059-4023-a9c3-9fd9c0a72794 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.682833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c983058-7059-4023-a9c3-9fd9c0a72794" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.682833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c983058-7059-4023-a9c3-9fd9c0a72794" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.683283] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c983058-7059-4023-a9c3-9fd9c0a72794" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.683283] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c983058-7059-4023-a9c3-9fd9c0a72794',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.703905] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.740903] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('addf6e3f-5f8b-4dab-9993-c2789c9f491a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.751800] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.802950] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.803148] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.803208] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.805191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.805191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.805191] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.805191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.805191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.805191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.805191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.805191] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0f823fa-9f2d-40f7-9630-8dee9229983a is going to be updated. [ 1012.847183] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.847384] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.847439] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.847791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.847906] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.862761] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0f823fa-9f2d-40f7-9630-8dee9229983a in Status: IN_PROGRESS for 2s [ 1012.929382] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: SUCCESS [ 1012.929382] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 deletion is rescheduled due to dependency. [ 1012.929481] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.183392] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.183610] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.186216] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c983058-7059-4023-a9c3-9fd9c0a72794 with status ACTIVE [ 1013.187451] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.187451] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.187451] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.187451] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.187451] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.188031] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.188031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.188031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.188031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.188228] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.188406] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.189107] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.189107] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.189107] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.189107] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.189107] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c983058-7059-4023-a9c3-9fd9c0a72794 is going to be updated. [ 1013.205360] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.205548] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.205548] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.205987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.205987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.206129] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 1013.217046] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.217203] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.217357] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.217606] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.217755] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.217942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c983058-7059-4023-a9c3-9fd9c0a72794" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.243107] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.243324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.243402] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.243631] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.243799] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.243905] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a is going to be updated. [ 1013.254947] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.254947] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.254947] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.255311] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.255311] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.255451] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d88934f6-85c4-4f45-a1fc-042377e3901a is going to be updated. [ 1013.290565] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.290763] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.290864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.291496] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.291681] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.295550] env[66994]: INFO networking_nsxv3.common.synchronization [req-f281d979-6956-4545-9426-9b10e2934468 req-4d4e0002-7b0e-4bf4-adf0-95fa5a9e5641 tempest-ServerDiskConfigTestJSON-2121377508 tempest-ServerDiskConfigTestJSON-2121377508-project-member] Enqueued Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 1013.296340] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 1013.296653] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.296776] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.296873] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.297212] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.297397] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.297513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.297554] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.298240] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.298240] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.298240] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.324962] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 1013.343740] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.343740] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.343740] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.343740] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.343740] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.352031] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.352031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.352031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.352031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.352031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.356954] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a in Status: IN_PROGRESS for 2s [ 1013.363749] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: IN_PROGRESS for 2s [ 1013.448208] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: SUCCESS [ 1013.448454] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e deletion is rescheduled due to dependency. [ 1013.448527] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.448691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.448925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.449137] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.449255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.449313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.449728] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.449728] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.449728] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.789475] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-172 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.789670] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-172" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.789794] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-172" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.790186] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-172" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.790488] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.790651] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.790768] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.790998] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.791265] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.791531] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.791686] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.791842] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.791981] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.792138] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.792273] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.792448] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.800401] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.800615] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.800615] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.800826] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.800927] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.801189] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.801311] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.801371] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.801535] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.801612] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.801712] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 is going to be updated. [ 1013.820353] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.820533] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1013.820712] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.820958] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-172" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.821355] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-4d1917bb-a894-4010-84d6-61e0094cc0d8 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.823718] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-4d1917bb-a894-4010-84d6-61e0094cc0d8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.823718] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-4d1917bb-a894-4010-84d6-61e0094cc0d8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.823718] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-4d1917bb-a894-4010-84d6-61e0094cc0d8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.823718] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d1917bb-a894-4010-84d6-61e0094cc0d8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.836127] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.836317] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.836410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.836585] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.836720] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.847748] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: IN_PROGRESS for 2s [ 1013.919547] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d in Status: SUCCESS [ 1013.919958] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d deletion is rescheduled due to dependency. [ 1013.919958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.952984] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.327947] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.327947] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.327947] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.328642] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.328642] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.328642] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 4d1917bb-a894-4010-84d6-61e0094cc0d8 not found, creating... [ 1014.328642] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.328797] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.328903] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.329142] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.329284] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.329570] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.329718] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.329833] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.330056] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.330197] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.330330] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 4d1917bb-a894-4010-84d6-61e0094cc0d8 is going to be created. [ 1014.364975] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.365180] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.365180] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.367081] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.367875] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.368436] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-4d1917bb-a894-4010-84d6-61e0094cc0d8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.455923] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.873681] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0f823fa-9f2d-40f7-9630-8dee9229983a in Status: SUCCESS [ 1014.873886] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0f823fa-9f2d-40f7-9630-8dee9229983a deletion is rescheduled due to dependency. [ 1014.874104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.959039] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.959423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.959423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.959636] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.959754] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.959867] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e is going to be updated. [ 1014.992523] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.992763] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.992823] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.993093] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.993290] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.003988] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: IN_PROGRESS for 2s [ 1015.049890] env[66994]: INFO networking_nsxv3.common.synchronization [req-f281d979-6956-4545-9426-9b10e2934468 req-2ff756b3-4a1d-441d-a53b-d019e4270b76 service nova] Enqueued Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_rules [ 1015.050095] env[66994]: INFO networking_nsxv3.common.synchronization [req-f281d979-6956-4545-9426-9b10e2934468 req-2ff756b3-4a1d-441d-a53b-d019e4270b76 service nova] Enqueued Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 1015.050380] env[66994]: INFO networking_nsxv3.common.synchronization [req-f281d979-6956-4545-9426-9b10e2934468 req-2ff756b3-4a1d-441d-a53b-d019e4270b76 service nova] Enqueued Resource ID: 4d1917bb-a894-4010-84d6-61e0094cc0d8 with Priority: HIGHEST for action port [ 1015.050826] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_rules [ 1015.051069] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 1015.051546] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d1917bb-a894-4010-84d6-61e0094cc0d8 with Priority: HIGHEST for action port [ 1015.051858] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.052098] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.052221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.052561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.052706] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.054144] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.054263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.054565] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d1917bb-a894-4010-84d6-61e0094cc0d8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.054565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d1917bb-a894-4010-84d6-61e0094cc0d8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.054945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d1917bb-a894-4010-84d6-61e0094cc0d8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.054945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d1917bb-a894-4010-84d6-61e0094cc0d8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.054945] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d1917bb-a894-4010-84d6-61e0094cc0d8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.337824] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 1015.338057] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.367673] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a in Status: SUCCESS [ 1015.368391] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.368391] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.368875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.368875] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.369215] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.369215] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.369215] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.369428] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.369428] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.369538] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('addf6e3f-5f8b-4dab-9993-c2789c9f491a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.374459] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: SUCCESS [ 1015.374459] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.377363] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.377653] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.377944] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.378078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.378174] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.378376] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.378591] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.378591] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.378672] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.556675] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.556937] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.559274] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d1917bb-a894-4010-84d6-61e0094cc0d8 with status ACTIVE [ 1015.559274] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.559274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.559274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.559274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.559274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.559274] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.559274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.559274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.559274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.559274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.559274] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.559274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.559274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.559274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.559274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.559274] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d1917bb-a894-4010-84d6-61e0094cc0d8 is going to be updated. [ 1015.585741] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.585741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.585741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.585741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.585741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.585741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d1917bb-a894-4010-84d6-61e0094cc0d8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.843212] env[66994]: INFO networking_nsxv3.common.synchronization [req-b4ba2e48-e927-40aa-bd90-57bf2488fe14 req-8fb84b38-d666-46c8-90e3-f7194be7674d tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: 6962fc63-b756-4b19-961f-af46a31eb946 with Priority: HIGHEST for action security_group_members [ 1015.843212] env[66994]: INFO networking_nsxv3.common.synchronization [req-b4ba2e48-e927-40aa-bd90-57bf2488fe14 req-8fb84b38-d666-46c8-90e3-f7194be7674d tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 1015.843212] env[66994]: INFO networking_nsxv3.common.synchronization [req-b4ba2e48-e927-40aa-bd90-57bf2488fe14 req-8fb84b38-d666-46c8-90e3-f7194be7674d tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a with Priority: HIGHEST for action security_group_members [ 1015.844072] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6962fc63-b756-4b19-961f-af46a31eb946 with Priority: HIGHEST for action security_group_members [ 1015.844072] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 1015.844285] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a with Priority: HIGHEST for action security_group_members [ 1015.844467] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-6962fc63-b756-4b19-961f-af46a31eb946 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.844601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6962fc63-b756-4b19-961f-af46a31eb946" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.844692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6962fc63-b756-4b19-961f-af46a31eb946" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.844951] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6962fc63-b756-4b19-961f-af46a31eb946" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.845127] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.845274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.845573] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.845573] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.845573] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.846039] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6962fc63-b756-4b19-961f-af46a31eb946',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.846647] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.847775] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.847898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.848306] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.848306] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.848306] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.848551] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.848551] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.848647] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.848785] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.849622] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-addf6e3f-5f8b-4dab-9993-c2789c9f491a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.849751] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.849963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.849963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.850390] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.850390] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.850390] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.850593] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.850593] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.850693] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('addf6e3f-5f8b-4dab-9993-c2789c9f491a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.866776] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: SUCCESS [ 1015.867095] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 deletion is rescheduled due to dependency. [ 1015.867179] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.867725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.867956] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.868310] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.868850] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.868989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.869214] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.869349] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.870731] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.874057] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('addf6e3f-5f8b-4dab-9993-c2789c9f491a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.882145] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.882145] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.905941] env[66994]: INFO networking_nsxv3.common.synchronization [req-b4ba2e48-e927-40aa-bd90-57bf2488fe14 req-8fb84b38-d666-46c8-90e3-f7194be7674d tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: 6962fc63-b756-4b19-961f-af46a31eb946 with Priority: HIGHEST for action security_group_rules [ 1015.906158] env[66994]: INFO networking_nsxv3.common.synchronization [req-b4ba2e48-e927-40aa-bd90-57bf2488fe14 req-8fb84b38-d666-46c8-90e3-f7194be7674d tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: 6962fc63-b756-4b19-961f-af46a31eb946 with Priority: HIGHEST for action security_group_members [ 1015.906298] env[66994]: INFO networking_nsxv3.common.synchronization [req-b4ba2e48-e927-40aa-bd90-57bf2488fe14 req-8fb84b38-d666-46c8-90e3-f7194be7674d tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a with Priority: HIGHEST for action security_group_rules [ 1015.906425] env[66994]: INFO networking_nsxv3.common.synchronization [req-b4ba2e48-e927-40aa-bd90-57bf2488fe14 req-8fb84b38-d666-46c8-90e3-f7194be7674d tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a with Priority: HIGHEST for action security_group_members [ 1015.906559] env[66994]: INFO networking_nsxv3.common.synchronization [req-b4ba2e48-e927-40aa-bd90-57bf2488fe14 req-8fb84b38-d666-46c8-90e3-f7194be7674d tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_rules [ 1015.906685] env[66994]: INFO networking_nsxv3.common.synchronization [req-b4ba2e48-e927-40aa-bd90-57bf2488fe14 req-8fb84b38-d666-46c8-90e3-f7194be7674d tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 1015.906815] env[66994]: INFO networking_nsxv3.common.synchronization [req-b4ba2e48-e927-40aa-bd90-57bf2488fe14 req-8fb84b38-d666-46c8-90e3-f7194be7674d tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: 68d450c3-2cc8-436a-9c92-2fcf52368e7c with Priority: HIGHEST for action port [ 1015.908075] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6962fc63-b756-4b19-961f-af46a31eb946 with Priority: HIGHEST for action security_group_rules [ 1015.908137] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a with Priority: HIGHEST for action security_group_rules [ 1015.908222] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 1015.908366] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68d450c3-2cc8-436a-9c92-2fcf52368e7c with Priority: HIGHEST for action port [ 1015.908419] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_rules [ 1015.908469] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6962fc63-b756-4b19-961f-af46a31eb946 with Priority: HIGHEST for action security_group_members [ 1015.908608] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a with Priority: HIGHEST for action security_group_members [ 1015.908924] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6962fc63-b756-4b19-961f-af46a31eb946 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.909135] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6962fc63-b756-4b19-961f-af46a31eb946" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.909135] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6962fc63-b756-4b19-961f-af46a31eb946" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.909379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6962fc63-b756-4b19-961f-af46a31eb946" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.909464] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6962fc63-b756-4b19-961f-af46a31eb946',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.910543] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-addf6e3f-5f8b-4dab-9993-c2789c9f491a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.910636] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.910830] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.910947] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.911115] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-68d450c3-2cc8-436a-9c92-2fcf52368e7c taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.911217] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68d450c3-2cc8-436a-9c92-2fcf52368e7c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.911283] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68d450c3-2cc8-436a-9c92-2fcf52368e7c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.912995] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68d450c3-2cc8-436a-9c92-2fcf52368e7c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.912995] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68d450c3-2cc8-436a-9c92-2fcf52368e7c',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.912995] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.912995] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.912995] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-6962fc63-b756-4b19-961f-af46a31eb946 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.912995] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6962fc63-b756-4b19-961f-af46a31eb946" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.913407] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-addf6e3f-5f8b-4dab-9993-c2789c9f491a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.914039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.354174] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.355629] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6962fc63-b756-4b19-961f-af46a31eb946',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.359628] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('addf6e3f-5f8b-4dab-9993-c2789c9f491a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.374078] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.374162] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for addf6e3f-5f8b-4dab-9993-c2789c9f491a: rpc.has_security_group_logging(os_id): False [ 1016.393613] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.393791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.393919] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.394150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.394260] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.394486] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.394594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.394653] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.394852] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.395015] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.395078] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a is going to be created. [ 1016.414603] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-6962fc63-b756-4b19-961f-af46a31eb946 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.414825] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6962fc63-b756-4b19-961f-af46a31eb946" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.417306] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68d450c3-2cc8-436a-9c92-2fcf52368e7c with status ACTIVE [ 1016.418415] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.418415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.418415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.418415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.418415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.418415] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.418415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.418415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.418732] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.418732] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.418804] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.418887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.418966] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.419166] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.419244] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.419332] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68d450c3-2cc8-436a-9c92-2fcf52368e7c is going to be updated. [ 1016.442032] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.442225] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.442273] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.442508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.442894] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.442894] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68d450c3-2cc8-436a-9c92-2fcf52368e7c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.480581] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.480680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.480721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.483736] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.483736] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.515665] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a in Status: IN_PROGRESS for 2s [ 1016.857182] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.861681] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6962fc63-b756-4b19-961f-af46a31eb946',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.863670] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('addf6e3f-5f8b-4dab-9993-c2789c9f491a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.877066] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.017313] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: SUCCESS [ 1017.017313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.017313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.017313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.017313] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.017313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.017313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.017313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.017313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.017313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.017313] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.359263] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.359576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.359576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.359964] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.360058] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.360216] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d88934f6-85c4-4f45-a1fc-042377e3901a is going to be updated. [ 1017.368988] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.369380] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.369380] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.369544] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.369678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.369820] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a is going to be updated. [ 1017.371255] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.371388] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.371457] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.371667] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.371755] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.371849] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6962fc63-b756-4b19-961f-af46a31eb946 is going to be created. [ 1017.380304] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.380466] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.380536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.380758] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.380867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.380952] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 is going to be updated. [ 1017.420413] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.420413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.420413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.420413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.420413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.422972] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.422972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.422972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.422972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.422972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.425202] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.425445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.425572] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.425859] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.426115] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.430730] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.430936] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.431177] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.431461] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.431671] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.445540] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: IN_PROGRESS for 2s [ 1017.446305] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a in Status: IN_PROGRESS for 2s [ 1017.446932] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: IN_PROGRESS for 2s [ 1017.448050] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6962fc63-b756-4b19-961f-af46a31eb946 in Status: UNINITIALIZED for 2s [ 1017.452374] env[66994]: INFO networking_nsxv3.common.synchronization [None req-7a5673bb-7513-432a-97cf-bafbec5f7bb4 tempest-AttachVolumeNegativeTest-1341698298 tempest-AttachVolumeNegativeTest-1341698298-project-member] Enqueued Resource ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 with Priority: HIGHEST for action security_group_rules [ 1017.452949] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 with Priority: HIGHEST for action security_group_rules [ 1017.453441] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-705505ff-4cd1-493a-b249-a5178fb4ee23 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.453583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.453757] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.453964] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.454098] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('705505ff-4cd1-493a-b249-a5178fb4ee23',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.520204] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.567043] env[66994]: INFO networking_nsxv3.common.synchronization [None req-c96d643d-6837-464f-a6b7-5e553e290e78 tempest-AttachVolumeNegativeTest-1341698298 tempest-AttachVolumeNegativeTest-1341698298-project-member] Enqueued Resource ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 with Priority: HIGHEST for action security_group_rules [ 1017.567730] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 with Priority: HIGHEST for action security_group_rules [ 1017.568034] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-705505ff-4cd1-493a-b249-a5178fb4ee23 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.568136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.979888] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.979888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.979888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.979888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.979888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.979888] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 already deleted. [ 1017.979888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.979888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.979888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.979888] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('705505ff-4cd1-493a-b249-a5178fb4ee23',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.023478] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24a08da7-cf3b-41d4-b7f4-8e3b7616589e: rpc.has_security_group_logging(os_id): False [ 1018.052419] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.052611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.052695] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.052917] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.053016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.053273] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.053376] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.053437] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.053665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.053778] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.053893] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e is going to be updated. [ 1018.159436] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.159675] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.159675] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.160083] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.160283] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.178933] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: IN_PROGRESS for 2s [ 1018.515914] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.516676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.516676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.516676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.516909] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.516955] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 already deleted. [ 1018.517040] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.536757] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a in Status: SUCCESS [ 1018.537221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.537434] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.539341] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.539341] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('addf6e3f-5f8b-4dab-9993-c2789c9f491a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.579458] env[66994]: INFO networking_nsxv3.common.synchronization [req-3826f26a-44e5-4736-905b-c550beb07d65 req-e30345ed-8bf3-4ba9-a639-2495f0e3ce0f tempest-DeleteServersTestJSON-15988793 tempest-DeleteServersTestJSON-15988793-project-member] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1018.580328] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1018.580328] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.580539] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.580539] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.581154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.581154] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.581154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.581455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.581455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.581455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.581650] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.015116] env[66994]: INFO networking_nsxv3.common.synchronization [req-74120236-63e5-43be-9876-4c4d92a8ee1d req-7b17445c-5ccd-4d3d-8172-4ef123a76a25 tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 1019.015300] env[66994]: INFO networking_nsxv3.common.synchronization [req-74120236-63e5-43be-9876-4c4d92a8ee1d req-7b17445c-5ccd-4d3d-8172-4ef123a76a25 tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a with Priority: HIGHEST for action security_group_members [ 1019.015433] env[66994]: INFO networking_nsxv3.common.synchronization [req-74120236-63e5-43be-9876-4c4d92a8ee1d req-7b17445c-5ccd-4d3d-8172-4ef123a76a25 tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: 6962fc63-b756-4b19-961f-af46a31eb946 with Priority: HIGHEST for action security_group_members [ 1019.016073] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 1019.016210] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a with Priority: HIGHEST for action security_group_members [ 1019.016322] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6962fc63-b756-4b19-961f-af46a31eb946 with Priority: HIGHEST for action security_group_members [ 1019.016887] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.017030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.017516] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-addf6e3f-5f8b-4dab-9993-c2789c9f491a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.017648] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.017847] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-6962fc63-b756-4b19-961f-af46a31eb946 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.017934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6962fc63-b756-4b19-961f-af46a31eb946" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.041575] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-addf6e3f-5f8b-4dab-9993-c2789c9f491a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.041702] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.084725] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.084725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.084725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.084725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.084725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.085040] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.085040] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.085040] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.086261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.086261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.086261] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be updated. [ 1019.120914] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.120914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.120914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.120914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.120914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.133091] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: IN_PROGRESS for 2s [ 1019.366755] env[66994]: INFO networking_nsxv3.common.synchronization [req-9fde3da4-b97e-4ea9-83b6-dac499ee9607 req-23f71e2c-599a-4057-99ed-f6caf285d081 tempest-ImagesTestJSON-691407333 tempest-ImagesTestJSON-691407333-project-member] Enqueued Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 1019.366755] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 1019.367979] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.367979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.367979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.367979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.367979] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.367979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.367979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.367979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.367979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.368455] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.461448] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: SUCCESS [ 1019.461749] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.462696] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6962fc63-b756-4b19-961f-af46a31eb946 in Status: SUCCESS [ 1019.462900] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6962fc63-b756-4b19-961f-af46a31eb946" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.463084] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.463313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.463514] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.463721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.463865] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.464080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.464180] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.464386] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.464618] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.464707] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.464768] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.464917] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.465075] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.466022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.466022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.466022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.466022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.466022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.466022] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.466637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6962fc63-b756-4b19-961f-af46a31eb946" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.466801] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6962fc63-b756-4b19-961f-af46a31eb946" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.466957] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.467068] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.467141] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.467300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.467375] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.467462] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6962fc63-b756-4b19-961f-af46a31eb946',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.469672] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a in Status: SUCCESS [ 1019.469672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.470321] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: SUCCESS [ 1019.470496] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.470651] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.470814] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.471130] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.471272] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.471310] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.471561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.471682] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.471782] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.473013] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.473178] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.473375] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.474131] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.474131] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.474131] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.474131] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.474131] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('addf6e3f-5f8b-4dab-9993-c2789c9f491a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.474847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.474932] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.476505] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.476505] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.476505] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.476505] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.476505] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.476505] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.476505] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.871915] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.970590] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d88934f6-85c4-4f45-a1fc-042377e3901a: rpc.has_security_group_logging(os_id): False [ 1019.978043] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.978043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.978043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.978043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.978043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.978331] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.978433] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.979395] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.979395] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.979395] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.979395] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a is going to be updated. [ 1019.980422] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.981287] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.981402] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.982068] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.982068] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.982068] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.982068] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.982068] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.982415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.982415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.982415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.982415] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6962fc63-b756-4b19-961f-af46a31eb946 is going to be deleted. [ 1019.983623] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.983623] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.983745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.984028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.984028] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.984165] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.984206] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.984480] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.984480] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.984480] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.984610] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.984706] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.984782] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.984931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.985065] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.985145] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.985332] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.985403] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.985455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.986036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.986036] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.988036] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.988153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.988243] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.988448] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.988543] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.988720] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.988816] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.988877] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.989078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.989291] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.989363] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.989455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.989515] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.989660] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.989845] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.989906] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.990095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.990095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.991024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.991024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.991024] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d88934f6-85c4-4f45-a1fc-042377e3901a is going to be updated. [ 1020.014677] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.014831] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.014899] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.015178] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.015329] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.017276] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.017402] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.017451] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.017591] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.017673] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.017766] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6962fc63-b756-4b19-961f-af46a31eb946" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.020028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6962fc63-b756-4b19-961f-af46a31eb946" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.020028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6962fc63-b756-4b19-961f-af46a31eb946" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.020028] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.020028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.020028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.020028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.020028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.020028] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6962fc63-b756-4b19-961f-af46a31eb946',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.026905] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a in Status: IN_PROGRESS for 2s [ 1020.056530] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.056707] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.056796] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.057316] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.057316] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.079935] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: IN_PROGRESS for 2s [ 1020.193218] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: SUCCESS [ 1020.193218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.375057] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.483974] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.492951] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b62a4f35-964f-404b-ba36-70b4e8cb2dc5: rpc.has_security_group_logging(os_id): False [ 1020.514381] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.514517] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.514557] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.514799] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.514895] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.515125] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.515248] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.515328] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.515496] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.515583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.515790] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.515862] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.515971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.516138] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.516212] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.516422] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.516542] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.516577] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.516710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.517279] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.517396] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 is going to be updated. [ 1020.521821] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.521963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.522035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.522206] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.522291] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.522474] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.522568] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.522626] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.522767] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.522830] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.522914] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6962fc63-b756-4b19-961f-af46a31eb946 already deleted. [ 1020.522993] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6962fc63-b756-4b19-961f-af46a31eb946" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.523122] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6962fc63-b756-4b19-961f-af46a31eb946',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.524348] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6962fc63-b756-4b19-961f-af46a31eb946" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.524521] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6962fc63-b756-4b19-961f-af46a31eb946" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.524663] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.524762] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.524819] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.524975] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.525054] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.525136] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6962fc63-b756-4b19-961f-af46a31eb946',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.590738] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.590968] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.591098] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.591359] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.591523] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.603725] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: IN_PROGRESS for 2s [ 1020.878060] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.878433] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.878433] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.878612] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.878702] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.878803] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e is going to be updated. [ 1020.908227] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.908386] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.908461] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.908685] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.908835] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.920952] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: IN_PROGRESS for 2s [ 1020.987361] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.987893] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.987893] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.987893] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.987893] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.988048] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d88934f6-85c4-4f45-a1fc-042377e3901a is going to be updated. [ 1021.024701] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.024855] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.024909] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.025239] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.025307] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.026516] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6962fc63-b756-4b19-961f-af46a31eb946',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.027514] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.027630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.027701] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.028682] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.028682] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.028682] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.028682] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.028682] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.028682] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.028682] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.028682] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6962fc63-b756-4b19-961f-af46a31eb946 already deleted. [ 1021.028682] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6962fc63-b756-4b19-961f-af46a31eb946" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.039220] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: IN_PROGRESS for 2s [ 1021.143136] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: SUCCESS [ 1021.143350] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 deletion is rescheduled due to dependency. [ 1021.143467] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.529849] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6962fc63-b756-4b19-961f-af46a31eb946: rpc.has_security_group_logging(os_id): False [ 1021.551229] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.551343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.551410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.551614] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.551696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.551955] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.552062] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.552130] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.552283] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.552361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.552450] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6962fc63-b756-4b19-961f-af46a31eb946 is going to be created. [ 1021.573303] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/6962fc63-b756-4b19-961f-af46a31eb946], does not exist path=[/infra/domains/default/groups/6962fc63-b756-4b19-961f-af46a31eb946]."\n}' [ 1021.573480] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6962fc63-b756-4b19-961f-af46a31eb946 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/6962fc63-b756-4b19-961f-af46a31eb946 [ 1021.575304] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1021.618115] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.618115] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.618115] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.618115] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.619344] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.619640] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.619757] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.619821] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.620019] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.620103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.620293] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.620912] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.620912] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.620912] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.620912] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.620912] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6962fc63-b756-4b19-961f-af46a31eb946 is going to be created. [ 1021.641405] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/6962fc63-b756-4b19-961f-af46a31eb946], does not exist path=[/infra/domains/default/groups/6962fc63-b756-4b19-961f-af46a31eb946]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/6962fc63-b756-4b19-961f-af46a31eb946 [ 1021.641405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6962fc63-b756-4b19-961f-af46a31eb946" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.641405] env[66994]: Traceback (most recent call last): [ 1021.641405] env[66994]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1021.641405] env[66994]: return func(*args, **kwargs) [ 1021.641405] env[66994]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1021.641405] env[66994]: res.raise_for_status() [ 1021.641405] env[66994]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1021.641405] env[66994]: raise HTTPError(http_error_msg, response=self) [ 1021.641405] env[66994]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/6962fc63-b756-4b19-961f-af46a31eb946 [ 1021.641405] env[66994]: During handling of the above exception, another exception occurred: [ 1021.641405] env[66994]: Traceback (most recent call last): [ 1021.641405] env[66994]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1021.641405] env[66994]: listener.cb(fileno) [ 1021.641405] env[66994]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1021.641405] env[66994]: result = function(*args, **kwargs) [ 1021.641405] env[66994]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1021.641405] env[66994]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1021.641405] env[66994]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1021.641405] env[66994]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1021.641405] env[66994]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1021.641405] env[66994]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1021.641405] env[66994]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1021.641405] env[66994]: res.raise_for_status() [ 1021.641405] env[66994]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1021.641405] env[66994]: raise HTTPError(http_error_msg, response=self) [ 1021.641405] env[66994]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/6962fc63-b756-4b19-961f-af46a31eb946 [ 1021.641405] env[66994]: Removing descriptor: 5 [ 1022.042184] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a in Status: SUCCESS [ 1022.042542] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a deletion is rescheduled due to dependency. [ 1022.042542] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.042804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.042905] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.043042] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.043275] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.043412] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.043879] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.043879] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.044725] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('addf6e3f-5f8b-4dab-9993-c2789c9f491a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.098210] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: SUCCESS [ 1022.098546] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.098732] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.099160] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.099160] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.145884] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.146176] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.147417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.147417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.147417] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.340616] env[66994]: INFO networking_nsxv3.common.synchronization [req-2eacebaf-9cca-4f62-8cfc-e7f063fcd959 req-0cad63a8-476e-4409-8ff8-0519c3293fdf tempest-ServerActionsTestOtherA-355769928 tempest-ServerActionsTestOtherA-355769928-project-member] Enqueued Resource ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 with Priority: HIGHEST for action security_group_members [ 1022.342407] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 with Priority: HIGHEST for action security_group_members [ 1022.343327] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-82eee1f9-542d-4c43-a79d-01ed4a642272 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.343501] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.343571] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.343896] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.344151] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.345434] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.345434] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.345434] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.345611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.346234] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82eee1f9-542d-4c43-a79d-01ed4a642272',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.393314] env[66994]: INFO networking_nsxv3.common.synchronization [None req-bcdeb05f-4594-4714-9824-47bc54bb7d26 None None] Enqueued Resource ID: ea701380-8b84-431c-b60c-79cbcddd151a with Priority: HIGHEST for action port [ 1022.394297] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea701380-8b84-431c-b60c-79cbcddd151a with Priority: HIGHEST for action port [ 1022.394297] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea701380-8b84-431c-b60c-79cbcddd151a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.394413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea701380-8b84-431c-b60c-79cbcddd151a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.394413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea701380-8b84-431c-b60c-79cbcddd151a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.395222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea701380-8b84-431c-b60c-79cbcddd151a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.395222] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea701380-8b84-431c-b60c-79cbcddd151a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.550420] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.550716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.550842] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.551136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.577089] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.577089] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.577089] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.577089] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.577089] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.577089] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.577089] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a is going to be updated. [ 1022.603242] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.603403] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.603772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.603772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.603880] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.605542] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.605542] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.621458] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a in Status: IN_PROGRESS for 2s [ 1022.624773] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: SUCCESS [ 1022.625016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.651685] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.849756] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.849919] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.849992] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.850241] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.850363] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.850623] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.850744] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.850782] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.850965] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.851077] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.851179] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 already deleted. [ 1022.851263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.878011] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-732 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.878240] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-732" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.878379] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-732" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.878744] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-732" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.878904] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.879068] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.879183] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.879445] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.879582] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.879788] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1022.879896] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.879998] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.880119] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.880222] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1022.880321] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.880446] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.898437] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea701380-8b84-431c-b60c-79cbcddd151a [ 1022.898437] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.898437] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.898697] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.898788] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.898836] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.898916] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea701380-8b84-431c-b60c-79cbcddd151a already deleted. [ 1022.899019] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea701380-8b84-431c-b60c-79cbcddd151a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.900726] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.900894] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1022.901045] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.901248] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-732" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.901543] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-a3d23f71-ab04-4ffa-b846-d1f467f3c44f taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.901711] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-a3d23f71-ab04-4ffa-b846-d1f467f3c44f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.901827] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-a3d23f71-ab04-4ffa-b846-d1f467f3c44f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.902160] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-a3d23f71-ab04-4ffa-b846-d1f467f3c44f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.902429] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3d23f71-ab04-4ffa-b846-d1f467f3c44f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.931623] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: SUCCESS [ 1022.931623] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.050590] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: SUCCESS [ 1023.053021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.053021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.053021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.053021] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.053021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.053021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.053021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.053749] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.053916] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.153595] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.405404] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.405679] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.405787] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.406143] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.406298] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.406449] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port a3d23f71-ab04-4ffa-b846-d1f467f3c44f not found, creating... [ 1023.406715] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.406869] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.406979] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.407592] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.407733] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.408210] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.408500] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.408669] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.408948] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.409120] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.409264] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: a3d23f71-ab04-4ffa-b846-d1f467f3c44f is going to be created. [ 1023.443881] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.443881] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.443881] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.446293] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.446637] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.447310] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-a3d23f71-ab04-4ffa-b846-d1f467f3c44f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.560355] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.657814] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1023.657895] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1024.064101] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.166832] env[66994]: INFO networking_nsxv3.common.synchronization [req-2eacebaf-9cca-4f62-8cfc-e7f063fcd959 req-04d4bfdd-fa39-41f3-bc2c-8c4b0d8be0e6 service nova] Enqueued Resource ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 with Priority: HIGHEST for action security_group_rules [ 1024.166935] env[66994]: INFO networking_nsxv3.common.synchronization [req-2eacebaf-9cca-4f62-8cfc-e7f063fcd959 req-04d4bfdd-fa39-41f3-bc2c-8c4b0d8be0e6 service nova] Enqueued Resource ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 with Priority: HIGHEST for action security_group_members [ 1024.167079] env[66994]: INFO networking_nsxv3.common.synchronization [req-2eacebaf-9cca-4f62-8cfc-e7f063fcd959 req-04d4bfdd-fa39-41f3-bc2c-8c4b0d8be0e6 service nova] Enqueued Resource ID: a3d23f71-ab04-4ffa-b846-d1f467f3c44f with Priority: HIGHEST for action port [ 1024.167757] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 with Priority: HIGHEST for action security_group_rules [ 1024.167841] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 with Priority: HIGHEST for action security_group_members [ 1024.167930] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3d23f71-ab04-4ffa-b846-d1f467f3c44f with Priority: HIGHEST for action port [ 1024.168742] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82eee1f9-542d-4c43-a79d-01ed4a642272 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.168874] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.168977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.169203] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.169286] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82eee1f9-542d-4c43-a79d-01ed4a642272',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.170579] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-82eee1f9-542d-4c43-a79d-01ed4a642272 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.170696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.170768] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.171110] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.171110] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.171234] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.171234] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.171612] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.171612] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.171612] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82eee1f9-542d-4c43-a79d-01ed4a642272',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.172950] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3d23f71-ab04-4ffa-b846-d1f467f3c44f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.172950] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3d23f71-ab04-4ffa-b846-d1f467f3c44f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.172950] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3d23f71-ab04-4ffa-b846-d1f467f3c44f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.172950] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3d23f71-ab04-4ffa-b846-d1f467f3c44f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.172950] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3d23f71-ab04-4ffa-b846-d1f467f3c44f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.307641] env[66994]: INFO networking_nsxv3.common.synchronization [None req-58edc924-50f4-4502-8541-e0be56498ba8 tempest-AttachInterfacesTestJSON-1437683655 tempest-AttachInterfacesTestJSON-1437683655-project-member] Enqueued Resource ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 with Priority: HIGHEST for action security_group_rules [ 1024.309938] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 with Priority: HIGHEST for action security_group_rules [ 1024.310395] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab40fd20-8903-42f0-a8a2-66a0ed5248f4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.310508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.310508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.310791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.311057] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab40fd20-8903-42f0-a8a2-66a0ed5248f4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.424722] env[66994]: INFO networking_nsxv3.common.synchronization [None req-13108365-a628-4fa8-bb86-ec3c9c3a341d tempest-AttachInterfacesTestJSON-1437683655 tempest-AttachInterfacesTestJSON-1437683655-project-member] Enqueued Resource ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 with Priority: HIGHEST for action security_group_rules [ 1024.425662] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 with Priority: HIGHEST for action security_group_rules [ 1024.426704] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab40fd20-8903-42f0-a8a2-66a0ed5248f4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.426841] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.487369] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.487580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.487656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.487859] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.510124] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1024.510774] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.513036] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1024.552973] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.553361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.553492] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.553931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.574354] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.575503] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1024.575630] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1024.575709] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1024.577343] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.577971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.577971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.577971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.578135] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.578269] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d88934f6-85c4-4f45-a1fc-042377e3901a is going to be updated. [ 1024.613014] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.613213] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.613691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.613970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.614137] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.627867] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.627987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.628789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.629100] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.633637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.633790] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1024.635642] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: IN_PROGRESS for 2s [ 1024.647450] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a in Status: SUCCESS [ 1024.647654] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a deletion is rescheduled due to dependency. [ 1024.647768] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.647980] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.648626] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.648626] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.648626] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.648626] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.648868] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.648921] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.649051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.649148] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('addf6e3f-5f8b-4dab-9993-c2789c9f491a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.674979] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-82eee1f9-542d-4c43-a79d-01ed4a642272 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.678293] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.678293] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('82eee1f9-542d-4c43-a79d-01ed4a642272',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.678293] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3d23f71-ab04-4ffa-b846-d1f467f3c44f with status ACTIVE [ 1024.678758] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.678758] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.678874] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.679109] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.679296] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.679595] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.679766] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.679884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.680164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.680342] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.684022] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.684022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.684022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.684022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.684022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.684022] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3d23f71-ab04-4ffa-b846-d1f467f3c44f is going to be updated. [ 1024.704690] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.704850] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.704916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.705224] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.705374] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.705552] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3d23f71-ab04-4ffa-b846-d1f467f3c44f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.750264] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.750528] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.750592] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.750812] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.751639] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.751639] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1024.788192] env[66994]: INFO networking_nsxv3.common.synchronization [None req-5d41eb7a-8bdf-4610-960a-908bd75e7c05 None None] Enqueued Resource ID: 763f556d-9c3d-4d49-a53c-167c1ec75798 with Priority: HIGHEST for action port [ 1024.788862] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763f556d-9c3d-4d49-a53c-167c1ec75798 with Priority: HIGHEST for action port [ 1024.790170] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-763f556d-9c3d-4d49-a53c-167c1ec75798 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.790337] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-763f556d-9c3d-4d49-a53c-167c1ec75798" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.790412] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-763f556d-9c3d-4d49-a53c-167c1ec75798" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.790761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-763f556d-9c3d-4d49-a53c-167c1ec75798" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.790761] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('763f556d-9c3d-4d49-a53c-167c1ec75798',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.833954] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.833954] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.833954] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.833954] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.834398] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.834398] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 already deleted. [ 1024.834398] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.834398] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.834640] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.834640] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab40fd20-8903-42f0-a8a2-66a0ed5248f4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.869038] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.869212] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.869299] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.869519] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.869782] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.871618] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:42. [ 1024.873016] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'2d27e4c7-d245-4441-888e-94841b693538', '9ca0171b-7165-4d45-aa70-8fe66df074eb', '88a75cae-9123-4d4d-9e51-add1196ab1f2', '24a08da7-cf3b-41d4-b7f4-8e3b7616589e', 'e7c25236-fc58-43cd-bd73-8bca62dfbd5e', 'b62a4f35-964f-404b-ba36-70b4e8cb2dc5', '6dbf99f5-e2f2-4d4a-a2c0-855c798d247f', '30dd50aa-556a-4adf-a58a-c76defad2778', '9e351cb9-ed41-4a93-8257-1a5acb7b4f9e', 'bc9a0c95-f9f4-4eb7-a275-05d69816e71d', 'c0f823fa-9f2d-40f7-9630-8dee9229983a', 'a5a17dbe-38a0-49a6-88df-5879a5d5333f', '5dbec57c-866e-4292-acf4-6de3635c21b3', '9108b2cc-cd11-4784-9282-52da311e05f1', '33070768-249a-4c90-b087-54185820f170', 'c4739c3c-8ad5-4540-a6bb-cc50fab810cc', '9c718081-e5df-4901-a082-56a5b8ccbf2d', 'b0030483-0783-4db3-971a-f3155da229b7', 'addf6e3f-5f8b-4dab-9993-c2789c9f491a', 'd15cba36-9c0e-45f0-8225-a808a551bd40', '34bde346-4da1-4dd8-ad15-cd1afe320304', '3ea9c700-dac6-4282-90b7-8b85af493263', '4fdf001c-b425-433f-b4c2-dcd41fc81f02', '11c0b684-9731-4046-89ad-f4bf7b2168d4', 'de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8', 'a6612b52-6412-47ab-8918-14b6b8bca0cb', 'a66f6cb4-94dc-4701-ac62-f6c6e4d4e305', '8ffb70f8-4012-40ec-b9e7-bc37e90e6e70', '2f159d71-0083-4a40-882f-2a28e3868c96', '44494650-6b02-4361-a53d-fb11ecaa53f2', 'd88934f6-85c4-4f45-a1fc-042377e3901a', '01dce4c1-af3a-4e00-a26c-16f52625131a', '91e3865c-9322-423a-9d64-5c548ef52da8', 'd4672e8d-a5ca-46f8-8d7b-adf4da6e472b', '34a807f7-3865-4ec7-9af1-5f447e70423b', '52c814d2-8c46-4f11-a3ab-47d2b96480f7', 'aaddbb4b-3076-42ef-afd8-2dcbedf8773e', '841e623a-3249-4bd3-878a-817068626c8a', '9cde16ce-be95-4b19-a4ea-e24f03fb1476', '0023a3cd-aa32-4af2-a423-608695d50731', 'e887c3d4-547e-480b-bd4c-f503fcb02ca5', '88bd36a2-b7c7-405c-ba4b-c36eb190f52e'} {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1024.873191] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1024.894739] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.894922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.894922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.895081] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.895143] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.895244] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1024.895311] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1024.895388] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1024.980570] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.980754] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.980790] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.981030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.982138] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.982403] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1024.982473] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1024.982626] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1024.982626] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1024.982740] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/42 resources of Type:Security Group Rules [ 1024.982807] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2d27e4c7-d245-4441-888e-94841b693538 with Priority: HIGH for action security_group_rules [ 1024.982863] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGH for action security_group_rules [ 1024.982912] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGH for action security_group_rules [ 1024.982963] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGH for action security_group_rules [ 1024.983023] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e with Priority: HIGH for action security_group_rules [ 1024.983077] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGH for action security_group_rules [ 1024.983130] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f with Priority: HIGH for action security_group_rules [ 1024.983190] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 30dd50aa-556a-4adf-a58a-c76defad2778 with Priority: HIGH for action security_group_rules [ 1024.983239] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e with Priority: HIGH for action security_group_rules [ 1024.983374] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d with Priority: HIGH for action security_group_rules [ 1024.983374] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c0f823fa-9f2d-40f7-9630-8dee9229983a with Priority: HIGH for action security_group_rules [ 1024.983374] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f with Priority: HIGH for action security_group_rules [ 1024.983531] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGH for action security_group_rules [ 1024.983531] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGH for action security_group_rules [ 1024.983659] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 33070768-249a-4c90-b087-54185820f170 with Priority: HIGH for action security_group_rules [ 1024.983659] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c4739c3c-8ad5-4540-a6bb-cc50fab810cc with Priority: HIGH for action security_group_rules [ 1024.983659] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d with Priority: HIGH for action security_group_rules [ 1024.983768] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGH for action security_group_rules [ 1024.983768] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a with Priority: HIGH for action security_group_rules [ 1024.983837] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d15cba36-9c0e-45f0-8225-a808a551bd40 with Priority: HIGH for action security_group_rules [ 1024.983918] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.155747] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('addf6e3f-5f8b-4dab-9993-c2789c9f491a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.184866] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('82eee1f9-542d-4c43-a79d-01ed4a642272',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.293548] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 763f556d-9c3d-4d49-a53c-167c1ec75798 [ 1025.293680] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.293831] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.294059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.295414] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.295414] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.295578] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:763f556d-9c3d-4d49-a53c-167c1ec75798 already deleted. [ 1025.295619] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-763f556d-9c3d-4d49-a53c-167c1ec75798" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.360302] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.360302] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.360302] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.360302] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.360302] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.360302] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 already deleted. [ 1025.360302] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.658023] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for addf6e3f-5f8b-4dab-9993-c2789c9f491a: rpc.has_security_group_logging(os_id): False [ 1025.676597] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.676787] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.676833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.677172] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.691672] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.691672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.691672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.691672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.691672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.691672] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 is going to be created. [ 1025.700105] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.700424] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.701155] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.701249] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.701249] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.701249] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.701249] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a is going to be updated. [ 1025.721411] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.721411] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.721411] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.721411] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.721411] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.729161] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 in Status: UNINITIALIZED for 2s [ 1025.765553] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.765744] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.765876] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.766044] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.766782] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.779579] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a in Status: IN_PROGRESS for 2s [ 1026.646099] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: SUCCESS [ 1026.646419] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.646513] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.646697] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.646888] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.647060] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.647060] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.647220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.647354] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.647412] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.647470] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.151052] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.151341] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.151423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.151731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.151909] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.152026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.152097] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.152834] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.152834] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.152834] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.152834] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.152834] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.152834] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.153203] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.153203] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.153203] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.153318] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.153392] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.153449] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.153536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.153613] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.656445] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d88934f6-85c4-4f45-a1fc-042377e3901a: rpc.has_security_group_logging(os_id): False [ 1027.677549] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.677549] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.677549] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.677549] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.698993] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.699300] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.699432] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.699511] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.699724] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.699808] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.700052] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.700167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.700279] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.700387] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.700454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.700650] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.700775] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.700857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.701295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.701393] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.701579] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d88934f6-85c4-4f45-a1fc-042377e3901a is going to be updated. [ 1027.747215] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 in Status: SUCCESS [ 1027.747553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.747553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.749027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.749027] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.749027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.749027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.749027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.749027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.749027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.749027] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('82eee1f9-542d-4c43-a79d-01ed4a642272',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.783117] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.783318] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.783359] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.783569] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.783738] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.797532] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a in Status: SUCCESS [ 1027.797741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.811049] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: IN_PROGRESS for 2s [ 1028.250921] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-82eee1f9-542d-4c43-a79d-01ed4a642272 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.251078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.251132] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.251324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.251488] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.251585] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.251645] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.251803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.251913] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.252053] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.252217] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-82eee1f9-542d-4c43-a79d-01ed4a642272 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.252324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.252381] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.252559] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.252719] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.252810] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.252810] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.252994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.252994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.253533] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.253533] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('82eee1f9-542d-4c43-a79d-01ed4a642272',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.756372] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 82eee1f9-542d-4c43-a79d-01ed4a642272: rpc.has_security_group_logging(os_id): False [ 1028.777466] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.777686] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.777686] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.777906] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.778025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.778283] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.778368] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.778368] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.778500] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.779411] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.779411] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.779411] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.779411] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.779411] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.779411] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.779411] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.779783] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.779783] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.779783] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.779783] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.780017] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 is going to be created. [ 1028.844401] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.844611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.844611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.844812] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.844994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.857942] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 in Status: IN_PROGRESS for 2s [ 1029.790577] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1029.790577] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=2 [ 1029.790577] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d27e4c7-d245-4441-888e-94841b693538 with Priority: HIGH for action security_group_rules [ 1029.790577] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGH for action security_group_rules [ 1029.790577] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f with Priority: HIGH for action security_group_rules [ 1029.790577] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33070768-249a-4c90-b087-54185820f170 with Priority: HIGH for action security_group_rules [ 1029.790577] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d15cba36-9c0e-45f0-8225-a808a551bd40 with Priority: HIGH for action security_group_rules [ 1029.790577] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a with Priority: HIGH for action security_group_rules [ 1029.790577] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGH for action security_group_rules [ 1029.790577] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d with Priority: HIGH for action security_group_rules [ 1029.790577] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9108b2cc-cd11-4784-9282-52da311e05f1 with Priority: HIGH for action security_group_rules [ 1029.790577] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4739c3c-8ad5-4540-a6bb-cc50fab810cc with Priority: HIGH for action security_group_rules [ 1029.791284] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 with Priority: HIGH for action security_group_rules [ 1029.791284] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f with Priority: HIGH for action security_group_rules [ 1029.791284] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f823fa-9f2d-40f7-9630-8dee9229983a with Priority: HIGH for action security_group_rules [ 1029.791284] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d with Priority: HIGH for action security_group_rules [ 1029.791284] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e with Priority: HIGH for action security_group_rules [ 1029.791284] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGH for action security_group_rules [ 1029.791284] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30dd50aa-556a-4adf-a58a-c76defad2778 with Priority: HIGH for action security_group_rules [ 1029.791284] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e with Priority: HIGH for action security_group_rules [ 1029.791533] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb with Priority: HIGH for action security_group_rules [ 1029.791533] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGH for action security_group_rules [ 1029.791831] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d27e4c7-d245-4441-888e-94841b693538 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.791995] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.792078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.792330] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.792419] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d27e4c7-d245-4441-888e-94841b693538',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.793848] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88a75cae-9123-4d4d-9e51-add1196ab1f2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.794011] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.794097] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.794287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.794391] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.796163] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.796163] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.796163] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.796163] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.796163] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dbf99f5-e2f2-4d4a-a2c0-855c798d247f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.796662] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33070768-249a-4c90-b087-54185820f170 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.797551] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.797551] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.797551] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.797551] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33070768-249a-4c90-b087-54185820f170',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.798015] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d15cba36-9c0e-45f0-8225-a808a551bd40 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.798015] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.798015] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.798156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.798208] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.799104] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-addf6e3f-5f8b-4dab-9993-c2789c9f491a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.799214] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.799261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.799553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.799553] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('addf6e3f-5f8b-4dab-9993-c2789c9f491a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.800212] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.800317] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.800359] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.800567] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.800567] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.802041] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c718081-e5df-4901-a082-56a5b8ccbf2d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.802041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.802041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.802041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.802041] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.802392] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9108b2cc-cd11-4784-9282-52da311e05f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.802392] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.802555] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.803591] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.803591] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9108b2cc-cd11-4784-9282-52da311e05f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.803591] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4739c3c-8ad5-4540-a6bb-cc50fab810cc taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.803826] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.803826] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.803826] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.803943] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4739c3c-8ad5-4540-a6bb-cc50fab810cc',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.804588] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dbec57c-866e-4292-acf4-6de3635c21b3 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.804694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.804899] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.804899] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.805167] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dbec57c-866e-4292-acf4-6de3635c21b3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.806100] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5a17dbe-38a0-49a6-88df-5879a5d5333f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.806100] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.806100] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.806100] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.806100] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5a17dbe-38a0-49a6-88df-5879a5d5333f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.806881] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0f823fa-9f2d-40f7-9630-8dee9229983a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.806977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.807073] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.807237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.807311] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0f823fa-9f2d-40f7-9630-8dee9229983a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.808196] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc9a0c95-f9f4-4eb7-a275-05d69816e71d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.808293] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.808337] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.808737] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.808737] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc9a0c95-f9f4-4eb7-a275-05d69816e71d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.809585] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.809585] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.809726] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.809934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.810018] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e351cb9-ed41-4a93-8257-1a5acb7b4f9e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.810762] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.810880] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.810951] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.811208] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.811283] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.812267] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30dd50aa-556a-4adf-a58a-c76defad2778 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.812267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.812403] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.812845] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.812845] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30dd50aa-556a-4adf-a58a-c76defad2778',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.813342] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.813454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.813504] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.814295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.814295] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7c25236-fc58-43cd-bd73-8bca62dfbd5e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.814721] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ca0171b-7165-4d45-aa70-8fe66df074eb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.814817] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.814890] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.815061] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.815688] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ca0171b-7165-4d45-aa70-8fe66df074eb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.816457] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.816555] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.816619] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.816794] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.817352] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.844021] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.844021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.844021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.844021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.845030] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.845131] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.846085] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: SUCCESS [ 1029.846351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.864922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.867020] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d27e4c7-d245-4441-888e-94841b693538 is going to be deleted. [ 1029.867020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.867020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.886623] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.886623] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33070768-249a-4c90-b087-54185820f170 is going to be deleted. [ 1029.924482] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.924632] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.924684] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.924885] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.924983] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.925119] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d27e4c7-d245-4441-888e-94841b693538" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.940539] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.940716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.940805] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.941080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.941163] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.941306] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33070768-249a-4c90-b087-54185820f170" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.315701] env[66994]: INFO networking_nsxv3.common.synchronization [req-6e5a3739-4324-47e5-8b7e-d24e5093c343 req-69cdb2f1-7230-4f88-b8ad-c2968da1753f tempest-AttachVolumeNegativeTest-1341698298 tempest-AttachVolumeNegativeTest-1341698298-project-member] Enqueued Resource ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 with Priority: HIGHEST for action security_group_members [ 1030.316278] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 with Priority: HIGHEST for action security_group_members [ 1030.316589] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-705505ff-4cd1-493a-b249-a5178fb4ee23 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.316712] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.316778] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.317095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.317588] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.317711] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.317780] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.317955] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.318061] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.318165] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('705505ff-4cd1-493a-b249-a5178fb4ee23',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.319317] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d15cba36-9c0e-45f0-8225-a808a551bd40 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.319427] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.319490] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.319902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.320082] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.320178] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.320243] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.320389] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.320473] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.320554] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.320637] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.321972] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c718081-e5df-4901-a082-56a5b8ccbf2d taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.321972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.321972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.322200] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.322200] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.322283] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.322626] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.322626] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.322626] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.322626] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.322803] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.326665] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.326665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.326665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.326665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.326665] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.326665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.326665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.326973] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.326973] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.326973] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.327115] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.327750] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a75cae-9123-4d4d-9e51-add1196ab1f2 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.327846] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.327908] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.328063] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.328202] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.328415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.328415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.328517] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.328550] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.328658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.328703] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.330121] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.330248] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.330301] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.330460] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.331354] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.331354] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.331354] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.331354] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.331354] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.331354] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.331354] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6dbf99f5-e2f2-4d4a-a2c0-855c798d247f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.335821] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.335983] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.336170] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.336268] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.336419] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.336514] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.336575] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.336748] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.336814] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.336933] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.337023] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e351cb9-ed41-4a93-8257-1a5acb7b4f9e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.351277] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.351277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.351277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.351277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.351277] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.351277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.351277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.351277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.351277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.351277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.351277] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.390197] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.390398] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.390673] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.390932] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.394540] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.394540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.396035] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.396035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.396926] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.397146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.398247] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.398405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.399818] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.399818] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.400707] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.400707] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.401713] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.401828] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.402622] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.402701] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.403588] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.403717] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.404617] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.404673] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.429107] env[66994]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1030.429630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.429758] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5a17dbe-38a0-49a6-88df-5879a5d5333f is going to be deleted. [ 1030.430699] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.430909] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.451224] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.451394] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be deleted. [ 1030.452290] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.452500] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.452583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.452790] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: addf6e3f-5f8b-4dab-9993-c2789c9f491a is going to be deleted. [ 1030.453454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.453617] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.473229] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.473389] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4739c3c-8ad5-4540-a6bb-cc50fab810cc is going to be deleted. [ 1030.474936] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.478796] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.513350] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.513569] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30dd50aa-556a-4adf-a58a-c76defad2778 is going to be deleted. [ 1030.514637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.514927] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.524236] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.524490] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.526613] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.526810] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.537904] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.538371] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.543522] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.543522] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ca0171b-7165-4d45-aa70-8fe66df074eb is going to be deleted. [ 1030.544914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.545037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.567078] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.568329] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.569089] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.569313] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc9a0c95-f9f4-4eb7-a275-05d69816e71d is going to be deleted. [ 1030.570861] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.570861] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.582733] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.583310] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.595710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.596012] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9108b2cc-cd11-4784-9282-52da311e05f1 is going to be deleted. [ 1030.597018] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.597187] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.622314] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.622314] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.659390] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.659549] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7c25236-fc58-43cd-bd73-8bca62dfbd5e is going to be deleted. [ 1030.660572] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.660714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.679922] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.680121] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.707731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.707880] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dbec57c-866e-4292-acf4-6de3635c21b3 is going to be deleted. [ 1030.708798] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.709027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.721928] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-532 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.722144] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-532" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.722301] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-532" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.722509] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-532" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.722755] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.722906] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.723028] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.723744] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.723744] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.723744] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1030.723744] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1030.723949] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1030.723949] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1030.723949] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1030.724065] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1030.724271] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1030.771692] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.771936] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.774826] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1030.774983] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.051 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1030.774983] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1030.775196] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-532" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.775504] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-a2a246fc-d2d3-485a-85ff-c35e62ba3eef taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.775673] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-a2a246fc-d2d3-485a-85ff-c35e62ba3eef" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.775793] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-a2a246fc-d2d3-485a-85ff-c35e62ba3eef" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.776239] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-a2a246fc-d2d3-485a-85ff-c35e62ba3eef" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.776388] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2a246fc-d2d3-485a-85ff-c35e62ba3eef',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.778162] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.778282] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0f823fa-9f2d-40f7-9630-8dee9229983a is going to be deleted. [ 1030.779200] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.779406] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.779546] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.779609] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-addf6e3f-5f8b-4dab-9993-c2789c9f491a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.780234] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.780234] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.780369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.780369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5a17dbe-38a0-49a6-88df-5879a5d5333f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.781217] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.781217] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.781217] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.781410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.781410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.781529] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.781868] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.781868] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4739c3c-8ad5-4540-a6bb-cc50fab810cc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.781868] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.782030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.782063] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.782162] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30dd50aa-556a-4adf-a58a-c76defad2778" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.782286] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.782423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.782494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.782801] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ca0171b-7165-4d45-aa70-8fe66df074eb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.782801] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.783179] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.783179] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.783179] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc9a0c95-f9f4-4eb7-a275-05d69816e71d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.783179] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.783622] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.783622] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.783622] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9108b2cc-cd11-4784-9282-52da311e05f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.826850] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c718081-e5df-4901-a082-56a5b8ccbf2d taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.827228] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.827228] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.827362] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.827538] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.827645] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.827755] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.827944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.827944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.828056] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.828174] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c718081-e5df-4901-a082-56a5b8ccbf2d taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.828263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.828321] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.828546] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.828682] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.828774] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.828834] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.828970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.829050] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.829131] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.829219] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.830464] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.830581] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.830632] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.830992] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.831126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.831308] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.831404] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.831464] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.831603] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.831676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.831760] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 already deleted. [ 1030.833020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.833242] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.844231] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e351cb9-ed41-4a93-8257-1a5acb7b4f9e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.845256] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.845389] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.845458] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.845660] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.845820] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.846731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.846731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.846731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.846731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.846731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.846999] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.846999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.846999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.847139] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.847316] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.847383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.847419] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.847537] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.847617] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.847724] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.847831] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.849626] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.852400] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6dbf99f5-e2f2-4d4a-a2c0-855c798d247f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.857403] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.928055] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.928055] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.928055] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.928393] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.928580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.928766] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7c25236-fc58-43cd-bd73-8bca62dfbd5e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.934901] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 in Status: SUCCESS [ 1030.935418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.946424] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.946582] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.946693] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.946955] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.947115] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.947268] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dbec57c-866e-4292-acf4-6de3635c21b3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.061215] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.061609] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.061691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.061920] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.062027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.062150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0f823fa-9f2d-40f7-9630-8dee9229983a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.184029] env[66994]: INFO networking_nsxv3.common.synchronization [None req-eecfb131-c285-4fb6-ba1c-4b521c79bda4 None None] Enqueued Resource ID: 1f40ed38-1ad3-44b1-a001-335516a71e6a with Priority: HIGHEST for action port [ 1031.184029] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f40ed38-1ad3-44b1-a001-335516a71e6a with Priority: HIGHEST for action port [ 1031.184029] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f40ed38-1ad3-44b1-a001-335516a71e6a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.184029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f40ed38-1ad3-44b1-a001-335516a71e6a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.184029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f40ed38-1ad3-44b1-a001-335516a71e6a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.185866] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f40ed38-1ad3-44b1-a001-335516a71e6a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.186085] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f40ed38-1ad3-44b1-a001-335516a71e6a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.281313] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.281524] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.281632] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.282451] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.282451] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.282451] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port a2a246fc-d2d3-485a-85ff-c35e62ba3eef not found, creating... [ 1031.282451] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.282710] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.282710] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.283773] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.283773] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.283773] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.283773] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.283773] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.283773] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.284079] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.284177] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: a2a246fc-d2d3-485a-85ff-c35e62ba3eef is going to be created. [ 1031.311608] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.311872] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.311947] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.312232] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.312521] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.312753] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-a2a246fc-d2d3-485a-85ff-c35e62ba3eef" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.337153] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c718081-e5df-4901-a082-56a5b8ccbf2d: rpc.has_security_group_logging(os_id): False [ 1031.338286] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d15cba36-9c0e-45f0-8225-a808a551bd40: rpc.has_security_group_logging(os_id): False [ 1031.350567] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e: rpc.has_security_group_logging(os_id): False [ 1031.353270] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88a75cae-9123-4d4d-9e51-add1196ab1f2: rpc.has_security_group_logging(os_id): False [ 1031.354373] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b62a4f35-964f-404b-ba36-70b4e8cb2dc5: rpc.has_security_group_logging(os_id): False [ 1031.354994] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f: rpc.has_security_group_logging(os_id): False [ 1031.359813] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24a08da7-cf3b-41d4-b7f4-8e3b7616589e: rpc.has_security_group_logging(os_id): False [ 1031.376232] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.376423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.376468] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.376671] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.379281] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.379416] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.381157] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.381261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.382719] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.382819] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.383540] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.383639] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.385788] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.385889] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.395526] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.395692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.397147] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.397456] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.397549] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.397616] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.397808] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.397891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.397987] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d15cba36-9c0e-45f0-8225-a808a551bd40 is going to be updated. [ 1031.398949] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.399294] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.422800] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.423131] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.423282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.423328] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.423529] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.423663] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.423709] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e is going to be updated. [ 1031.424766] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.424945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.533378] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.533378] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.533378] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.533378] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.533378] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.534086] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.534086] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 is going to be updated. [ 1031.537098] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.537278] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.568625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.569028] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.569617] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.569617] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.569617] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.569617] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.569784] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.570665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.570665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.570665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.570665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.570665] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.570665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.570665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.570914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.570914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.570914] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d is going to be updated. [ 1031.576581] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.576581] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.585211] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.586854] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.593749] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.594146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.603250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.603701] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.603883] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.603940] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.604155] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.604242] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.604472] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.604576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.604635] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.604813] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.604893] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.605134] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.605255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.605328] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.605422] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.605497] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.605601] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 is going to be updated. [ 1031.607122] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.607505] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.638682] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.639030] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.639177] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.639237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.639406] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.639491] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.639591] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e is going to be updated. [ 1031.640771] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.640911] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.640988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.641984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.642097] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.642209] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.643129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.643302] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.662579] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e in Status: IN_PROGRESS for 2s [ 1031.668181] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d15cba36-9c0e-45f0-8225-a808a551bd40 in Status: IN_PROGRESS for 2s [ 1031.672797] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.673202] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.673339] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.673444] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.673691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.673790] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.673886] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f is going to be updated. [ 1031.676499] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.676499] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.676499] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.676663] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.677801] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.688910] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f40ed38-1ad3-44b1-a001-335516a71e6a [ 1031.689050] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.689141] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.689225] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.689578] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.689684] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.689768] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f40ed38-1ad3-44b1-a001-335516a71e6a already deleted. [ 1031.689849] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f40ed38-1ad3-44b1-a001-335516a71e6a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.737726] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.738011] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.738011] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.739353] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.743023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.761034] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.761034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.761034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.761034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.761034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.762257] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: IN_PROGRESS for 2s [ 1031.785137] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d in Status: IN_PROGRESS for 2s [ 1031.795456] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: IN_PROGRESS for 2s [ 1031.802914] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.802914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.802914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.802914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.802914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.843127] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: IN_PROGRESS for 2s [ 1031.883240] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.883423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.883495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.883677] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.883821] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.913360] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f in Status: IN_PROGRESS for 2s [ 1032.133606] env[66994]: INFO networking_nsxv3.common.synchronization [req-6e5a3739-4324-47e5-8b7e-d24e5093c343 req-aab15110-ae0c-42ef-89c5-d7633045fabc service nova] Enqueued Resource ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 with Priority: HIGHEST for action security_group_rules [ 1032.133702] env[66994]: INFO networking_nsxv3.common.synchronization [req-6e5a3739-4324-47e5-8b7e-d24e5093c343 req-aab15110-ae0c-42ef-89c5-d7633045fabc service nova] Enqueued Resource ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 with Priority: HIGHEST for action security_group_members [ 1032.133800] env[66994]: INFO networking_nsxv3.common.synchronization [req-6e5a3739-4324-47e5-8b7e-d24e5093c343 req-aab15110-ae0c-42ef-89c5-d7633045fabc service nova] Enqueued Resource ID: a2a246fc-d2d3-485a-85ff-c35e62ba3eef with Priority: HIGHEST for action port [ 1032.134736] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 with Priority: HIGHEST for action security_group_rules [ 1032.134881] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 with Priority: HIGHEST for action security_group_members [ 1032.134979] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2a246fc-d2d3-485a-85ff-c35e62ba3eef with Priority: HIGHEST for action port [ 1032.135370] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-705505ff-4cd1-493a-b249-a5178fb4ee23 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.135497] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.135588] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.135856] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.135856] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('705505ff-4cd1-493a-b249-a5178fb4ee23',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.136896] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-705505ff-4cd1-493a-b249-a5178fb4ee23 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.137344] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.137344] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.137615] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.137670] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.137782] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.137843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.139503] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.139503] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.139503] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('705505ff-4cd1-493a-b249-a5178fb4ee23',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.139503] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2a246fc-d2d3-485a-85ff-c35e62ba3eef taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.139503] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2a246fc-d2d3-485a-85ff-c35e62ba3eef" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.139503] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2a246fc-d2d3-485a-85ff-c35e62ba3eef" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.139503] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2a246fc-d2d3-485a-85ff-c35e62ba3eef" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.139503] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2a246fc-d2d3-485a-85ff-c35e62ba3eef',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.642206] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-705505ff-4cd1-493a-b249-a5178fb4ee23 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.642834] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.643515] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('705505ff-4cd1-493a-b249-a5178fb4ee23',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.644322] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2a246fc-d2d3-485a-85ff-c35e62ba3eef with status ACTIVE [ 1032.644548] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.645037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.645037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.645037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.645037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.645323] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.645323] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.645700] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.646224] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.646649] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.646888] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.647122] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.647231] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.647360] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.647536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.647636] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2a246fc-d2d3-485a-85ff-c35e62ba3eef is going to be updated. [ 1032.672164] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.672164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.672164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.672164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.672164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.672164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2a246fc-d2d3-485a-85ff-c35e62ba3eef" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.151179] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('705505ff-4cd1-493a-b249-a5178fb4ee23',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.612123] env[66994]: INFO networking_nsxv3.common.synchronization [None req-847058dc-7558-4a7e-a445-e14087254a6f None None] Enqueued Resource ID: afbf340b-eab9-4a9b-bebb-79711c1e973e with Priority: HIGHEST for action port [ 1033.612743] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afbf340b-eab9-4a9b-bebb-79711c1e973e with Priority: HIGHEST for action port [ 1033.612842] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-afbf340b-eab9-4a9b-bebb-79711c1e973e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.613027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afbf340b-eab9-4a9b-bebb-79711c1e973e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.613091] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afbf340b-eab9-4a9b-bebb-79711c1e973e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.613392] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afbf340b-eab9-4a9b-bebb-79711c1e973e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.613485] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afbf340b-eab9-4a9b-bebb-79711c1e973e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.656697] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.657688] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.657688] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.657688] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.657688] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.657688] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 is going to be created. [ 1033.684708] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e in Status: SUCCESS [ 1033.686090] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.688212] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.688396] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.688490] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.688837] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.689062] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.690843] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d15cba36-9c0e-45f0-8225-a808a551bd40 in Status: SUCCESS [ 1033.691083] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.700692] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 in Status: UNINITIALIZED for 2s [ 1033.781857] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: SUCCESS [ 1033.781857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.796960] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d in Status: SUCCESS [ 1033.796960] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.810783] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: SUCCESS [ 1033.810973] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.863996] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: SUCCESS [ 1033.864344] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.926025] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f in Status: SUCCESS [ 1033.926025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.117455] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port afbf340b-eab9-4a9b-bebb-79711c1e973e [ 1034.117921] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.117921] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.117921] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.118161] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.118245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.118346] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:afbf340b-eab9-4a9b-bebb-79711c1e973e already deleted. [ 1034.118508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afbf340b-eab9-4a9b-bebb-79711c1e973e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.711555] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 in Status: SUCCESS [ 1035.711906] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.711968] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.712372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.713126] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.713126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.713126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.713126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.713126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.713126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.713462] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('705505ff-4cd1-493a-b249-a5178fb4ee23',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.216862] env[66994]: INFO networking_nsxv3.common.synchronization [req-ace7585f-36f0-464b-92d5-8688e0b07d8c req-535a4f75-ec25-44cd-8ef3-0c3bfd0f446b tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 1036.217064] env[66994]: INFO networking_nsxv3.common.synchronization [req-ace7585f-36f0-464b-92d5-8688e0b07d8c req-535a4f75-ec25-44cd-8ef3-0c3bfd0f446b tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: d15cba36-9c0e-45f0-8225-a808a551bd40 with Priority: HIGHEST for action security_group_members [ 1036.217394] env[66994]: INFO networking_nsxv3.common.synchronization [req-ace7585f-36f0-464b-92d5-8688e0b07d8c req-535a4f75-ec25-44cd-8ef3-0c3bfd0f446b tempest-SecurityGroupsTestJSON-62767254 tempest-SecurityGroupsTestJSON-62767254-project-member] Enqueued Resource ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e with Priority: HIGHEST for action security_group_members [ 1036.218671] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('705505ff-4cd1-493a-b249-a5178fb4ee23',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.221324] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGHEST for action security_group_members [ 1036.221324] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d15cba36-9c0e-45f0-8225-a808a551bd40 with Priority: HIGHEST for action security_group_members [ 1036.221324] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e with Priority: HIGHEST for action security_group_members [ 1036.221324] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.221324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.221324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.221324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.221985] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.221985] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.221985] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.221985] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.221985] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.221985] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.222878] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d15cba36-9c0e-45f0-8225-a808a551bd40 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.222979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.223059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.223222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.223354] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.223448] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.223512] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.223638] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.223717] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.223800] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.224551] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.224651] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.224717] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.224860] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.224992] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.225092] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.225151] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.225284] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.225854] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.225854] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e351cb9-ed41-4a93-8257-1a5acb7b4f9e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.721156] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 705505ff-4cd1-493a-b249-a5178fb4ee23: rpc.has_security_group_logging(os_id): False [ 1036.727611] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.727611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.727611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.727981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.727981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.728149] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.728230] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.728614] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.728614] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.728614] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.728752] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d15cba36-9c0e-45f0-8225-a808a551bd40 is going to be updated. [ 1036.729949] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.730074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.730115] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.730334] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.730450] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.730717] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.730804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.732078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.732078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.732078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.732078] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d88934f6-85c4-4f45-a1fc-042377e3901a is going to be updated. [ 1036.732296] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.732360] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.732538] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.732642] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.732746] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.732935] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.733068] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.733163] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.733417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.733569] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.733807] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e is going to be updated. [ 1036.737298] env[66994]: INFO networking_nsxv3.common.synchronization [req-ec3e552e-4714-42b3-a954-3e3f617ab84d req-b676b08f-b70d-4afb-9e1a-f9115584a2c0 tempest-ServersTestJSON-587851554 tempest-ServersTestJSON-587851554-project-member] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 1036.738244] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 1036.738893] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.738893] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.738893] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.738893] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.739237] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.739237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.739370] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.739450] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.739517] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.739601] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.742135] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.742243] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.742311] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.742473] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.742588] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.742834] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.742923] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.742976] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.743137] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.743212] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.743300] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 is going to be created. [ 1036.772702] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.772883] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.772934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.773207] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.773401] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.775370] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.775505] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.775598] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.775789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.775915] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.777606] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.777724] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.777807] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.777953] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.778088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.790438] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e in Status: IN_PROGRESS for 2s [ 1036.791843] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: IN_PROGRESS for 2s [ 1036.792531] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d15cba36-9c0e-45f0-8225-a808a551bd40 in Status: IN_PROGRESS for 2s [ 1036.814210] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.814463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.814463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.814680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.814920] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.832014] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 in Status: IN_PROGRESS for 2s [ 1036.879513] env[66994]: INFO networking_nsxv3.common.synchronization [req-a863c2fe-8761-4076-a326-a32189b49582 req-2135c591-a959-464f-8664-52d3433fba2c tempest-ImagesTestJSON-691407333 tempest-ImagesTestJSON-691407333-project-member] Enqueued Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 1036.882118] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 1036.885026] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.885026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.885026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.885026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.885026] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.885026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.885026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.885026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.885026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.885026] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.130870] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.131155] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.131275] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.131659] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.132150] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.132260] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.132397] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.132650] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.132814] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.133095] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.133232] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1037.133413] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1037.133508] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1037.133691] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.133765] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1037.133903] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1037.155160] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1037.155337] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1037.155404] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1037.155643] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.155978] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-49197fc5-2777-4966-9f99-80e38255d4a8 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.156305] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-49197fc5-2777-4966-9f99-80e38255d4a8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.156598] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-49197fc5-2777-4966-9f99-80e38255d4a8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.157096] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-49197fc5-2777-4966-9f99-80e38255d4a8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.157418] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49197fc5-2777-4966-9f99-80e38255d4a8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.246830] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.386040] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.386279] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.386357] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.386576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.409671] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.409883] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.409967] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.409967] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.410202] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.410281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.410369] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e is going to be updated. [ 1037.442089] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.442471] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.442548] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.442758] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.442904] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.455469] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: IN_PROGRESS for 2s [ 1037.661039] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.661262] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.661408] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.661700] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.661852] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.662014] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 49197fc5-2777-4966-9f99-80e38255d4a8 not found, creating... [ 1037.662289] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.662478] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.662599] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.663569] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.663569] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.663569] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.663569] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.663569] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.663836] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.663897] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.664390] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 49197fc5-2777-4966-9f99-80e38255d4a8 is going to be created. [ 1037.684811] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.685098] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.685232] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.685534] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.685784] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.686106] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-49197fc5-2777-4966-9f99-80e38255d4a8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.748747] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.251080] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.251221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.251301] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.251545] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.251642] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.251726] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 1038.288340] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.288558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.288662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.288808] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.288959] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.300887] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 1038.401239] env[66994]: INFO networking_nsxv3.common.synchronization [req-ec3e552e-4714-42b3-a954-3e3f617ab84d req-bfba1fee-45a0-4386-8e63-2fa705398477 service nova] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_rules [ 1038.401518] env[66994]: INFO networking_nsxv3.common.synchronization [req-ec3e552e-4714-42b3-a954-3e3f617ab84d req-bfba1fee-45a0-4386-8e63-2fa705398477 service nova] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 1038.401711] env[66994]: INFO networking_nsxv3.common.synchronization [req-ec3e552e-4714-42b3-a954-3e3f617ab84d req-bfba1fee-45a0-4386-8e63-2fa705398477 service nova] Enqueued Resource ID: 49197fc5-2777-4966-9f99-80e38255d4a8 with Priority: HIGHEST for action port [ 1038.402916] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_rules [ 1038.402916] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 1038.402916] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49197fc5-2777-4966-9f99-80e38255d4a8 with Priority: HIGHEST for action port [ 1038.403478] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.403478] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.403565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.404638] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.404638] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.405595] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.405595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.405595] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-49197fc5-2777-4966-9f99-80e38255d4a8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.405595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49197fc5-2777-4966-9f99-80e38255d4a8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.405595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49197fc5-2777-4966-9f99-80e38255d4a8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.405595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49197fc5-2777-4966-9f99-80e38255d4a8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.406344] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49197fc5-2777-4966-9f99-80e38255d4a8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.810081] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e in Status: SUCCESS [ 1038.810399] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e deletion is rescheduled due to dependency. [ 1038.810399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.811132] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d88934f6-85c4-4f45-a1fc-042377e3901a in Status: SUCCESS [ 1038.811282] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d88934f6-85c4-4f45-a1fc-042377e3901a deletion is rescheduled due to dependency. [ 1038.811378] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.811973] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d15cba36-9c0e-45f0-8225-a808a551bd40 in Status: SUCCESS [ 1038.812130] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d15cba36-9c0e-45f0-8225-a808a551bd40 deletion is rescheduled due to dependency. [ 1038.812223] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.853890] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 in Status: SUCCESS [ 1038.854167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.907889] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.908124] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.908280] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 49197fc5-2777-4966-9f99-80e38255d4a8 with status ACTIVE [ 1038.908489] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.908676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.908792] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.908973] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.909068] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.909248] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.909340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.909400] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.909637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.909637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.909873] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.909988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.910070] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.910220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.910295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.910383] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 49197fc5-2777-4966-9f99-80e38255d4a8 is going to be updated. [ 1038.931560] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.931746] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.931813] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.932033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.932174] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.932387] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49197fc5-2777-4966-9f99-80e38255d4a8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.204997] env[66994]: INFO networking_nsxv3.common.synchronization [req-ad26b0a5-bae4-421c-ac3c-f810b3102c7f req-6a753aec-a9ba-4ab8-a1b5-f7a72ecb6f44 tempest-AttachInterfacesTestJSON-1437683655 tempest-AttachInterfacesTestJSON-1437683655-project-member] Enqueued Resource ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 with Priority: HIGHEST for action security_group_members [ 1039.205647] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 with Priority: HIGHEST for action security_group_members [ 1039.206172] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab40fd20-8903-42f0-a8a2-66a0ed5248f4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.206172] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.206401] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.206599] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.206765] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.206872] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.206931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.207099] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.207258] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.207359] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab40fd20-8903-42f0-a8a2-66a0ed5248f4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.467295] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: SUCCESS [ 1039.467605] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e deletion is rescheduled due to dependency. [ 1039.467705] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.589419] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.589581] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.589706] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.590084] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.590317] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.590469] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.590584] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.590798] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.590939] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.591628] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1039.591628] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1039.591628] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1039.591628] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1039.591628] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1039.591955] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1039.591955] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1039.613182] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1039.613475] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1039.613707] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1039.614404] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.614878] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-dcccba02-54fd-469a-a185-41ba57eff9bc taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.615442] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-dcccba02-54fd-469a-a185-41ba57eff9bc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.615442] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-dcccba02-54fd-469a-a185-41ba57eff9bc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.615632] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-dcccba02-54fd-469a-a185-41ba57eff9bc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.615795] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcccba02-54fd-469a-a185-41ba57eff9bc',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.709597] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.709767] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.709900] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.710151] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.710246] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.710470] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.710584] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.710646] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.710808] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.710884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.710973] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 already deleted. [ 1039.711064] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.119310] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.119661] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.119877] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.120202] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.120384] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.120578] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port dcccba02-54fd-469a-a185-41ba57eff9bc not found, creating... [ 1040.120937] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.121202] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.121436] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.121676] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.121918] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.123286] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.123679] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.123989] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.124378] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.124657] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.124803] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: dcccba02-54fd-469a-a185-41ba57eff9bc is going to be created. [ 1040.152789] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.153061] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.153218] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.153499] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.153739] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.153976] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-dcccba02-54fd-469a-a185-41ba57eff9bc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.312207] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 1040.312465] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.312646] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.312870] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.313106] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.313262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.313365] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.313548] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.313636] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.313734] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.817053] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.916345] env[66994]: INFO networking_nsxv3.common.synchronization [req-ad26b0a5-bae4-421c-ac3c-f810b3102c7f req-003bc375-79c2-4ae3-9ab3-28cc6f1d34d4 service nova] Enqueued Resource ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 with Priority: HIGHEST for action security_group_rules [ 1040.916556] env[66994]: INFO networking_nsxv3.common.synchronization [req-ad26b0a5-bae4-421c-ac3c-f810b3102c7f req-003bc375-79c2-4ae3-9ab3-28cc6f1d34d4 service nova] Enqueued Resource ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 with Priority: HIGHEST for action security_group_members [ 1040.916731] env[66994]: INFO networking_nsxv3.common.synchronization [req-ad26b0a5-bae4-421c-ac3c-f810b3102c7f req-003bc375-79c2-4ae3-9ab3-28cc6f1d34d4 service nova] Enqueued Resource ID: dcccba02-54fd-469a-a185-41ba57eff9bc with Priority: HIGHEST for action port [ 1040.917274] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 with Priority: HIGHEST for action security_group_rules [ 1040.917407] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 with Priority: HIGHEST for action security_group_members [ 1040.917500] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcccba02-54fd-469a-a185-41ba57eff9bc with Priority: HIGHEST for action port [ 1040.917768] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab40fd20-8903-42f0-a8a2-66a0ed5248f4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.917888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.918229] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.918746] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.918832] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab40fd20-8903-42f0-a8a2-66a0ed5248f4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.920238] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab40fd20-8903-42f0-a8a2-66a0ed5248f4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.920361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.920748] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.920971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.921143] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.921247] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.921309] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.921454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.921537] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.921623] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab40fd20-8903-42f0-a8a2-66a0ed5248f4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.923087] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcccba02-54fd-469a-a185-41ba57eff9bc taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.923199] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcccba02-54fd-469a-a185-41ba57eff9bc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.923300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcccba02-54fd-469a-a185-41ba57eff9bc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.923565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcccba02-54fd-469a-a185-41ba57eff9bc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.923810] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcccba02-54fd-469a-a185-41ba57eff9bc',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.319111] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.420796] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab40fd20-8903-42f0-a8a2-66a0ed5248f4 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.420984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.429373] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab40fd20-8903-42f0-a8a2-66a0ed5248f4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.430393] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dcccba02-54fd-469a-a185-41ba57eff9bc with status ACTIVE [ 1041.430530] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.430658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.430726] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.430927] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.431025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.431210] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.431313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.431375] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.431528] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.431599] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.431773] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.431863] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.431922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.432067] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.432347] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.432347] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dcccba02-54fd-469a-a185-41ba57eff9bc is going to be updated. [ 1041.455520] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.455683] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.455733] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.455940] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.456093] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.456288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcccba02-54fd-469a-a185-41ba57eff9bc" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.821632] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.821934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.822109] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.822401] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.822587] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.822738] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 1041.855536] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.855805] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.855805] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.856013] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.856182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.867437] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 1041.937053] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab40fd20-8903-42f0-a8a2-66a0ed5248f4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.443153] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.443153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.443153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.443153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.443742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.443742] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 is going to be created. [ 1042.470022] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.470369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.470369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.470979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.470979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.481088] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 in Status: UNINITIALIZED for 2s [ 1043.877813] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 1043.880017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.880017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.880017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.880017] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.880017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.880017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.880017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.880017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.880017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.880017] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.145607] env[66994]: INFO networking_nsxv3.common.synchronization [req-72fb122d-f3a8-4e79-9afb-d808bcf8215b req-3018044d-7cce-4d8a-be2e-b2e45d7be0b4 tempest-DeleteServersTestJSON-15988793 tempest-DeleteServersTestJSON-15988793-project-member] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1044.146267] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1044.146610] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.146734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.146795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.146994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.147334] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.147540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.147618] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.147789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.147856] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.147942] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.382698] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.382924] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.382988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.383320] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.383416] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.383680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.383680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.383808] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.383854] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.383896] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.384056] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.384152] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.384282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.384760] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.384760] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.384760] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.384760] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.385024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.385024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.385024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.385135] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.449602] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-160 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.450094] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.450094] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.450277] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.450549] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.450890] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.450890] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.451044] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.451147] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.451348] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1044.451462] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1044.451656] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1044.451752] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1044.451868] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1044.452075] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1044.452147] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1044.475817] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1044.475817] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1044.475817] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1044.475817] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.475817] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-23232a71-cc3e-4917-9d28-607a9039e8f1 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.475817] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-23232a71-cc3e-4917-9d28-607a9039e8f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.475817] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-23232a71-cc3e-4917-9d28-607a9039e8f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.475817] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-23232a71-cc3e-4917-9d28-607a9039e8f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.475817] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23232a71-cc3e-4917-9d28-607a9039e8f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.491662] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 in Status: SUCCESS [ 1044.491908] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.492132] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.492339] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.492528] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.492642] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.492703] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.492849] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.493145] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.493145] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.493145] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab40fd20-8903-42f0-a8a2-66a0ed5248f4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.650517] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.650680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.650761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.650983] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.651098] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.651439] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.651545] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.651695] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.651908] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.652039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.652158] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be deleted. [ 1044.687619] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.687840] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.687917] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.688179] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.688278] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.688414] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.888357] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8: rpc.has_security_group_logging(os_id): False [ 1044.915218] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.915359] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.915422] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.915673] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.940974] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.941298] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.941410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.941478] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.941718] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.941859] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.942149] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.942149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.942287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.942353] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.942427] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.942651] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.942719] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.942772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.942904] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.942976] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.943077] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 1044.979962] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.980253] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.980436] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.980789] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.981499] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.981499] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 23232a71-cc3e-4917-9d28-607a9039e8f1 not found, creating... [ 1044.981499] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.982154] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.982154] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.982154] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.982154] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.982387] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.982602] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.982732] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.982979] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.983137] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.983280] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 23232a71-cc3e-4917-9d28-607a9039e8f1 is going to be created. [ 1044.996712] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab40fd20-8903-42f0-a8a2-66a0ed5248f4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.012579] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.012918] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.012918] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.013180] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.013502] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.013741] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-23232a71-cc3e-4917-9d28-607a9039e8f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.027303] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.027483] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.027547] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.027799] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.027958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.047273] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 1045.500510] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab40fd20-8903-42f0-a8a2-66a0ed5248f4: rpc.has_security_group_logging(os_id): False [ 1045.520663] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.520963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.520963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.521115] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.521214] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.521479] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.521591] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.521673] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.522057] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.522057] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.522057] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 is going to be created. [ 1045.593129] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.593129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.593129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.593300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.593499] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.607610] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 in Status: IN_PROGRESS for 2s [ 1045.782208] env[66994]: INFO networking_nsxv3.common.synchronization [req-72fb122d-f3a8-4e79-9afb-d808bcf8215b req-ce8ace98-8822-4457-b385-387b2d9c7697 service nova] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_rules [ 1045.782389] env[66994]: INFO networking_nsxv3.common.synchronization [req-72fb122d-f3a8-4e79-9afb-d808bcf8215b req-ce8ace98-8822-4457-b385-387b2d9c7697 service nova] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1045.782526] env[66994]: INFO networking_nsxv3.common.synchronization [req-72fb122d-f3a8-4e79-9afb-d808bcf8215b req-ce8ace98-8822-4457-b385-387b2d9c7697 service nova] Enqueued Resource ID: 23232a71-cc3e-4917-9d28-607a9039e8f1 with Priority: HIGHEST for action port [ 1045.783036] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_rules [ 1045.783180] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1045.783274] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23232a71-cc3e-4917-9d28-607a9039e8f1 with Priority: HIGHEST for action port [ 1045.783596] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.783714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.783755] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.783945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.784037] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.785028] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.785197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.785254] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.785409] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.785559] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.785656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.785716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.785856] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.785939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.786037] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.786944] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-23232a71-cc3e-4917-9d28-607a9039e8f1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.787074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23232a71-cc3e-4917-9d28-607a9039e8f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.787142] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23232a71-cc3e-4917-9d28-607a9039e8f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.787475] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23232a71-cc3e-4917-9d28-607a9039e8f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.787475] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23232a71-cc3e-4917-9d28-607a9039e8f1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.289702] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.290194] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.290194] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23232a71-cc3e-4917-9d28-607a9039e8f1 with status ACTIVE [ 1046.290355] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.290536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.290536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.290821] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.290898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.291085] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.291191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.291348] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.291462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.291534] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.291764] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.291850] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.291916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.292087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.292189] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.292282] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23232a71-cc3e-4917-9d28-607a9039e8f1 is going to be updated. [ 1046.294050] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.332383] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.332620] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.332620] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.332808] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.332949] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.333127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23232a71-cc3e-4917-9d28-607a9039e8f1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.702588] env[66994]: INFO networking_nsxv3.common.synchronization [req-2fc20aba-a747-46d6-8261-33577681603f req-4d7c2283-6465-46a0-91b4-66c93da268af tempest-ServerMetadataNegativeTestJSON-241235940 tempest-ServerMetadataNegativeTestJSON-241235940-project-member] Enqueued Resource ID: fdc9f3b2-daa7-4881-83a2-d1c73f6b403b with Priority: HIGHEST for action security_group_members [ 1046.703167] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc9f3b2-daa7-4881-83a2-d1c73f6b403b with Priority: HIGHEST for action security_group_members [ 1046.703480] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.703601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.703677] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.703942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.704754] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.704754] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.704871] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.704984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.705105] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.705185] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdc9f3b2-daa7-4881-83a2-d1c73f6b403b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.758027] env[66994]: INFO networking_nsxv3.common.synchronization [req-cecfe3e9-a356-4b5a-ab7f-fccb2e7488bd req-b7a80666-09b5-40b7-bdbb-cfaa9312fd3e tempest-AttachVolumeShelveTestJSON-810060241 tempest-AttachVolumeShelveTestJSON-810060241-project-member] Enqueued Resource ID: 0023a3cd-aa32-4af2-a423-608695d50731 with Priority: HIGHEST for action security_group_members [ 1046.758027] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0023a3cd-aa32-4af2-a423-608695d50731 with Priority: HIGHEST for action security_group_members [ 1046.758027] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-0023a3cd-aa32-4af2-a423-608695d50731 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.758027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.758027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.758027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.758027] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.758027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.758027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.758027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.758027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.758027] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0023a3cd-aa32-4af2-a423-608695d50731',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.796887] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.067148] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 1047.067731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.128246] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-923 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.128521] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-923" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.128521] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-923" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.131138] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-923" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.131138] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.131138] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.131138] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.131138] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.131559] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.131632] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1047.131764] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1047.131864] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1047.131952] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1047.132072] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1047.132176] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1047.132308] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1047.153260] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1047.153439] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1047.153584] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1047.154154] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-923" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.154688] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-2c40a604-17f0-4700-9b51-aaea76d1d480 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.154887] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-2c40a604-17f0-4700-9b51-aaea76d1d480" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.155132] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-2c40a604-17f0-4700-9b51-aaea76d1d480" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.155396] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-2c40a604-17f0-4700-9b51-aaea76d1d480" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.155539] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c40a604-17f0-4700-9b51-aaea76d1d480',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.208761] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.208957] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.209059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.209757] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.209757] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.209757] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.209757] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.209757] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.210240] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.210240] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.210240] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc9f3b2-daa7-4881-83a2-d1c73f6b403b already deleted. [ 1047.210240] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.259463] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.259697] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.259814] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.260111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.289627] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.290052] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.290052] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.290532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.290532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.290532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.290693] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0023a3cd-aa32-4af2-a423-608695d50731 is going to be updated. [ 1047.299570] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.299739] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.300361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.300361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.300757] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.300862] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be created. [ 1047.342582] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.342709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.342709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.343339] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.343339] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.346143] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.346143] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.346143] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.346143] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.346143] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.356050] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0023a3cd-aa32-4af2-a423-608695d50731 in Status: IN_PROGRESS for 2s [ 1047.357176] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: UNINITIALIZED for 2s [ 1047.621745] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 in Status: SUCCESS [ 1047.621745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.658306] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.658529] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.658529] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.659245] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.659245] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.659245] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 2c40a604-17f0-4700-9b51-aaea76d1d480 not found, creating... [ 1047.659431] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.659503] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.659622] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.659855] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.660028] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.660310] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.660469] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.660587] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.660795] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.660930] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.661080] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 2c40a604-17f0-4700-9b51-aaea76d1d480 is going to be created. [ 1047.684827] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.685243] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.685373] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.685693] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.685951] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.686223] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-2c40a604-17f0-4700-9b51-aaea76d1d480" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.455515] env[66994]: INFO networking_nsxv3.common.synchronization [req-2fc20aba-a747-46d6-8261-33577681603f req-bf97a6b1-0e05-47df-9c1b-67b008572fcc service nova] Enqueued Resource ID: fdc9f3b2-daa7-4881-83a2-d1c73f6b403b with Priority: HIGHEST for action security_group_rules [ 1048.455904] env[66994]: INFO networking_nsxv3.common.synchronization [req-2fc20aba-a747-46d6-8261-33577681603f req-bf97a6b1-0e05-47df-9c1b-67b008572fcc service nova] Enqueued Resource ID: fdc9f3b2-daa7-4881-83a2-d1c73f6b403b with Priority: HIGHEST for action security_group_members [ 1048.455904] env[66994]: INFO networking_nsxv3.common.synchronization [req-2fc20aba-a747-46d6-8261-33577681603f req-bf97a6b1-0e05-47df-9c1b-67b008572fcc service nova] Enqueued Resource ID: 2c40a604-17f0-4700-9b51-aaea76d1d480 with Priority: HIGHEST for action port [ 1048.457180] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc9f3b2-daa7-4881-83a2-d1c73f6b403b with Priority: HIGHEST for action security_group_rules [ 1048.457499] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc9f3b2-daa7-4881-83a2-d1c73f6b403b with Priority: HIGHEST for action security_group_members [ 1048.457688] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c40a604-17f0-4700-9b51-aaea76d1d480 with Priority: HIGHEST for action port [ 1048.458208] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.458564] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.458564] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.459192] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.459192] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdc9f3b2-daa7-4881-83a2-d1c73f6b403b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.464038] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.464038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.464038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.464038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.464038] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.464038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.464038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.464038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.464038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.464038] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdc9f3b2-daa7-4881-83a2-d1c73f6b403b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.465273] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c40a604-17f0-4700-9b51-aaea76d1d480 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.465478] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c40a604-17f0-4700-9b51-aaea76d1d480" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.465587] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c40a604-17f0-4700-9b51-aaea76d1d480" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.466065] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c40a604-17f0-4700-9b51-aaea76d1d480" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.466627] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c40a604-17f0-4700-9b51-aaea76d1d480',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.962323] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.962512] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.965953] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdc9f3b2-daa7-4881-83a2-d1c73f6b403b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.971254] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c40a604-17f0-4700-9b51-aaea76d1d480 with status ACTIVE [ 1048.971568] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.972462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.972762] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.972897] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.973154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.973675] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.973956] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.974603] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.974872] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.974982] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.975243] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.975358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.975673] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.975673] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.975673] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.975834] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c40a604-17f0-4700-9b51-aaea76d1d480 is going to be updated. [ 1049.003396] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.004305] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.004421] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.004682] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.004852] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.005060] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c40a604-17f0-4700-9b51-aaea76d1d480" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.251617] env[66994]: INFO networking_nsxv3.common.synchronization [req-710abe5b-6f98-4578-8bd9-2857a287605a req-b616d4f5-6b3b-47eb-b55d-8643ec762ce4 tempest-ImagesTestJSON-691407333 tempest-ImagesTestJSON-691407333-project-member] Enqueued Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 1049.252283] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 1049.252600] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.252819] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.252819] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.253683] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.253877] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.254050] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.254150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.254516] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.254649] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.254763] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.368640] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0023a3cd-aa32-4af2-a423-608695d50731 in Status: SUCCESS [ 1049.368640] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0023a3cd-aa32-4af2-a423-608695d50731 deletion is rescheduled due to dependency. [ 1049.368962] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.369882] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: SUCCESS [ 1049.369996] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.370065] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.370313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.370476] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.370663] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.370663] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.371113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.371113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.371113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.371113] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.468991] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdc9f3b2-daa7-4881-83a2-d1c73f6b403b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.623304] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-744 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.623678] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-744" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.623760] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-744" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.624197] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-744" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.624580] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.624808] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.624934] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.625287] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.625510] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.625810] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1049.625985] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1049.626172] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1049.626342] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1049.626521] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1049.626689] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1049.626894] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1049.651808] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1049.652046] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1049.652250] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1049.652487] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-744" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.652962] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-a21c6848-c2bf-4fe1-a614-00781f17518c taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.653268] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-a21c6848-c2bf-4fe1-a614-00781f17518c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.653411] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-a21c6848-c2bf-4fe1-a614-00781f17518c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.653836] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-a21c6848-c2bf-4fe1-a614-00781f17518c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.654042] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a21c6848-c2bf-4fe1-a614-00781f17518c',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.757984] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.758165] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.758266] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.758492] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.758611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.758867] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.758988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.761080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.761080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.761080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.761080] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e is going to be updated. [ 1049.806757] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.806914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.807116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.807604] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.807604] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.816893] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: IN_PROGRESS for 2s [ 1049.873306] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.877021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.877021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.877021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.877021] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.877021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.877021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.877021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.877021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.877021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.877021] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.877021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.877021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.877021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.877021] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.877021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.877021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.877021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.877021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.877869] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.877869] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.972857] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.973030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.973073] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.973316] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.973421] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.973540] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc9f3b2-daa7-4881-83a2-d1c73f6b403b is going to be created. [ 1050.000022] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.000322] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.000419] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.000662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.000966] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.014063] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc9f3b2-daa7-4881-83a2-d1c73f6b403b in Status: UNINITIALIZED for 2s [ 1050.156989] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.157324] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.157534] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.157842] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.158022] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.158183] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port a21c6848-c2bf-4fe1-a614-00781f17518c not found, creating... [ 1050.158470] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.158640] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.158783] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.159045] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.159199] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.159495] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.159694] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.159827] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.160063] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.160203] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.160355] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: a21c6848-c2bf-4fe1-a614-00781f17518c is going to be created. [ 1050.181289] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.181585] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.181712] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.181975] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.182214] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.182433] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-a21c6848-c2bf-4fe1-a614-00781f17518c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.383331] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0030483-0783-4db3-971a-f3155da229b7: rpc.has_security_group_logging(os_id): False [ 1050.404179] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.404343] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.404409] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.404787] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.404787] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.405307] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.405481] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.405613] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.405888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.405888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.405996] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.406155] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.406155] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.406300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.406406] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.406610] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.406714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.406769] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.406911] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.406983] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.407085] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be created. [ 1050.481335] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.481722] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.481722] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.481846] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.481995] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.496229] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: IN_PROGRESS for 2s [ 1050.922250] env[66994]: INFO networking_nsxv3.common.synchronization [req-710abe5b-6f98-4578-8bd9-2857a287605a req-7bd1103a-1e75-4afc-83c8-baa28c5f9a25 service nova] Enqueued Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_rules [ 1050.922433] env[66994]: INFO networking_nsxv3.common.synchronization [req-710abe5b-6f98-4578-8bd9-2857a287605a req-7bd1103a-1e75-4afc-83c8-baa28c5f9a25 service nova] Enqueued Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 1050.922645] env[66994]: INFO networking_nsxv3.common.synchronization [req-710abe5b-6f98-4578-8bd9-2857a287605a req-7bd1103a-1e75-4afc-83c8-baa28c5f9a25 service nova] Enqueued Resource ID: a21c6848-c2bf-4fe1-a614-00781f17518c with Priority: HIGHEST for action port [ 1050.923787] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_rules [ 1050.924016] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 1050.924167] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a21c6848-c2bf-4fe1-a614-00781f17518c with Priority: HIGHEST for action port [ 1050.925099] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.925293] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.927263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.927536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.927677] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.931014] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.931014] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.931155] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-a21c6848-c2bf-4fe1-a614-00781f17518c taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.931224] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a21c6848-c2bf-4fe1-a614-00781f17518c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.931381] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a21c6848-c2bf-4fe1-a614-00781f17518c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.936886] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a21c6848-c2bf-4fe1-a614-00781f17518c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.936886] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a21c6848-c2bf-4fe1-a614-00781f17518c',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.048499] env[66994]: INFO networking_nsxv3.common.synchronization [req-03e355b6-7dca-4d23-b120-3bdd1c187007 req-82dcbf6d-70d7-41f5-b31c-71f0ad7b6e9c tempest-ServersTestJSON-587851554 tempest-ServersTestJSON-587851554-project-member] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 1051.049752] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 1051.050757] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.051057] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.051243] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.051536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.051784] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.052024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.052177] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.052424] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.052603] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.054257] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.160157] env[66994]: INFO networking_nsxv3.common.synchronization [req-698b241d-20cd-4353-9b06-616eba1aae95 req-1381b6f4-dcf6-4052-bd54-e51947a2802a tempest-ServerActionsTestOtherA-355769928 tempest-ServerActionsTestOtherA-355769928-project-member] Enqueued Resource ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 with Priority: HIGHEST for action security_group_members [ 1051.160682] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 with Priority: HIGHEST for action security_group_members [ 1051.161598] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-82eee1f9-542d-4c43-a79d-01ed4a642272 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.161598] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.161598] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.161598] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.161598] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.161598] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.161904] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.161904] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.161904] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.161996] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82eee1f9-542d-4c43-a79d-01ed4a642272',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.438703] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.438703] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.438975] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a21c6848-c2bf-4fe1-a614-00781f17518c with status ACTIVE [ 1051.439126] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.439246] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.439309] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.439515] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.439596] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.439761] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.439851] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.439908] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.440063] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.440148] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.440330] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.440437] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.440499] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.440599] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.440666] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.440744] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a21c6848-c2bf-4fe1-a614-00781f17518c is going to be updated. [ 1051.466962] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.466962] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.466962] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.466962] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.466962] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.466962] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a21c6848-c2bf-4fe1-a614-00781f17518c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.555222] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.664507] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.664738] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.664738] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.664967] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.665570] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.665748] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.665855] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.665919] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.666118] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.666201] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.666289] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 is going to be updated. [ 1051.730445] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.730670] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.730670] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.730868] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.731030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.746870] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 in Status: IN_PROGRESS for 2s [ 1051.829851] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: SUCCESS [ 1051.829992] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e deletion is rescheduled due to dependency. [ 1051.830067] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.830246] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.830465] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.830653] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.830849] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.830964] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.831127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.831228] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.831308] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.033302] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc9f3b2-daa7-4881-83a2-d1c73f6b403b in Status: SUCCESS [ 1052.033537] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.034889] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.035893] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.035893] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.035893] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.035893] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.036111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.036111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.036188] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.038611] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fdc9f3b2-daa7-4881-83a2-d1c73f6b403b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.058912] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.333934] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.516125] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: SUCCESS [ 1052.516538] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.538581] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.538871] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.538871] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.540193] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.540573] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.540728] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.540806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.544534] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.544534] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.544637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.544880] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.545037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.545126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.545329] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.545499] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.545598] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.545660] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.545876] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.545997] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.546131] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.546272] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fdc9f3b2-daa7-4881-83a2-d1c73f6b403b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.561757] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.562127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.562127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.562780] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.562780] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.562780] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 1052.597297] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.597511] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.597511] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.597721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.597871] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.607066] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 1052.839175] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.051612] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fdc9f3b2-daa7-4881-83a2-d1c73f6b403b: rpc.has_security_group_logging(os_id): False [ 1053.067664] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.067894] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.067981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.068208] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.068300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.068512] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.068667] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.068667] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.068877] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.068877] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.069060] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.069198] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.069245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.069375] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.069452] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.069638] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.070205] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.070205] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.070205] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.070205] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.070205] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdc9f3b2-daa7-4881-83a2-d1c73f6b403b is going to be created. [ 1053.136099] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.136099] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.136099] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.136099] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.136099] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.148166] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdc9f3b2-daa7-4881-83a2-d1c73f6b403b in Status: IN_PROGRESS for 2s [ 1053.339261] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.339651] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.339651] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.339805] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.339805] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.339914] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e is going to be updated. [ 1053.385542] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.385761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.385874] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.386198] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.386390] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.408266] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: IN_PROGRESS for 2s [ 1053.759158] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 in Status: SUCCESS [ 1053.759463] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 deletion is rescheduled due to dependency. [ 1053.759549] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.618858] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 1054.619099] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.160851] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdc9f3b2-daa7-4881-83a2-d1c73f6b403b in Status: SUCCESS [ 1055.161178] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.419930] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: SUCCESS [ 1055.420178] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.420347] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.420565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.420774] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.420890] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.420955] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.421136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.421215] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.421299] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.421389] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.924289] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.924508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.924642] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.924961] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.925221] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.925332] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.925488] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.925600] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.925711] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.925900] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.925996] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.926111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.926174] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.926336] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.926538] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.926637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.926685] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.926846] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.926924] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.927104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.927155] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.163038] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1056.163488] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1056.431087] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88bd36a2-b7c7-405c-ba4b-c36eb190f52e: rpc.has_security_group_logging(os_id): False [ 1056.453324] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.453548] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.453712] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.453972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.454845] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.454845] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.454845] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.455064] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.455660] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.455743] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.455946] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.456055] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.456125] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.456284] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.456362] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.456635] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.456765] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.456809] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.457273] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.457273] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.457273] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e is going to be updated. [ 1056.550892] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.550892] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.550892] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.550892] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.550892] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.572103] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: IN_PROGRESS for 2s [ 1058.590302] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: SUCCESS [ 1058.590715] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.843475] env[66994]: INFO networking_nsxv3.common.synchronization [None req-c96c1262-bb76-4021-afe3-67bc38c78b4a tempest-AttachVolumeShelveTestJSON-810060241 tempest-AttachVolumeShelveTestJSON-810060241-project-member] Enqueued Resource ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 with Priority: HIGHEST for action security_group_rules [ 1059.843999] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 with Priority: HIGHEST for action security_group_rules [ 1059.845031] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.845031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.845031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.845031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.845031] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.932044] env[66994]: INFO networking_nsxv3.common.synchronization [None req-b1a1e78e-7866-41c6-b49c-5e8beea0db95 tempest-AttachVolumeShelveTestJSON-810060241 tempest-AttachVolumeShelveTestJSON-810060241-project-member] Enqueued Resource ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 with Priority: HIGHEST for action security_group_rules [ 1059.932681] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 with Priority: HIGHEST for action security_group_rules [ 1059.933056] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.933283] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.368507] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.368741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.369271] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.369376] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.369446] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.369917] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 already deleted. [ 1060.369917] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.370102] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.370945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.370945] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.894051] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.894368] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.894368] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.895088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.895088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.895088] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 already deleted. [ 1060.895088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.835963] env[66994]: INFO networking_nsxv3.common.synchronization [req-f2fcb5a1-de58-43a6-b87a-3ecbdad15c9e req-686bcd0e-0db3-4a73-ab3d-26750fcd0104 tempest-ServerMetadataNegativeTestJSON-241235940 tempest-ServerMetadataNegativeTestJSON-241235940-project-member] Enqueued Resource ID: fdc9f3b2-daa7-4881-83a2-d1c73f6b403b with Priority: HIGHEST for action security_group_members [ 1061.835963] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc9f3b2-daa7-4881-83a2-d1c73f6b403b with Priority: HIGHEST for action security_group_members [ 1061.836992] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.836992] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.836992] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.836992] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.836992] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.837236] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.837236] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.837421] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.838083] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.838083] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdc9f3b2-daa7-4881-83a2-d1c73f6b403b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.340177] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.340613] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.340613] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.340901] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.341107] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.341448] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.341612] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.341737] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.342013] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.342175] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.342349] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc9f3b2-daa7-4881-83a2-d1c73f6b403b is going to be updated. [ 1062.380383] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.380618] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.380755] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.380930] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.381197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.391924] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc9f3b2-daa7-4881-83a2-d1c73f6b403b in Status: IN_PROGRESS for 2s [ 1064.410761] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdc9f3b2-daa7-4881-83a2-d1c73f6b403b in Status: SUCCESS [ 1064.411209] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdc9f3b2-daa7-4881-83a2-d1c73f6b403b deletion is rescheduled due to dependency. [ 1064.411209] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.594295] env[66994]: INFO networking_nsxv3.common.synchronization [None req-bef0faf4-48a1-4a2c-bd96-b1685592c4f4 tempest-ServerActionsTestOtherA-355769928 tempest-ServerActionsTestOtherA-355769928-project-member] Enqueued Resource ID: 086f38af-0633-4270-b4b2-f416d2945ae1 with Priority: HIGHEST for action security_group_rules [ 1064.594939] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 086f38af-0633-4270-b4b2-f416d2945ae1 with Priority: HIGHEST for action security_group_rules [ 1064.595303] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-086f38af-0633-4270-b4b2-f416d2945ae1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.595431] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.595500] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.595801] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.595902] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('086f38af-0633-4270-b4b2-f416d2945ae1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.721082] env[66994]: INFO networking_nsxv3.common.synchronization [None req-3557252d-3871-474d-abb2-e48babe12a2d tempest-ServerActionsTestOtherA-355769928 tempest-ServerActionsTestOtherA-355769928-project-member] Enqueued Resource ID: 086f38af-0633-4270-b4b2-f416d2945ae1 with Priority: HIGHEST for action security_group_rules [ 1064.721082] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 086f38af-0633-4270-b4b2-f416d2945ae1 with Priority: HIGHEST for action security_group_rules [ 1064.721801] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-086f38af-0633-4270-b4b2-f416d2945ae1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.722121] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.121842] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.121991] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.122087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.122305] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.122396] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.122492] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 086f38af-0633-4270-b4b2-f416d2945ae1 already deleted. [ 1065.122578] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.122730] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.122890] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.122970] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('086f38af-0633-4270-b4b2-f416d2945ae1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.647325] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.647676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.647676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.647776] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.647805] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.647905] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 086f38af-0633-4270-b4b2-f416d2945ae1 already deleted. [ 1065.647981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.741095] env[66994]: INFO networking_nsxv3.common.synchronization [req-ee6cbc28-24fc-44c8-be13-b0743a8107c4 req-3bcae7fa-da59-47db-9b5b-c75d14a8fcd5 tempest-DeleteServersTestJSON-15988793 tempest-DeleteServersTestJSON-15988793-project-member] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1068.741737] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1068.742247] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.742451] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.742451] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.742658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.742822] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.742921] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.742987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.743175] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.743263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.743365] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.246658] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.246658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.246658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.246658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.246658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.246936] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.246936] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.247081] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.247160] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.247240] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.247330] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be updated. [ 1069.283748] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.283993] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.283993] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.284180] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.284350] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.294755] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: IN_PROGRESS for 2s [ 1069.313960] env[66994]: INFO networking_nsxv3.common.synchronization [req-ea2eecf3-9477-42bd-8e1f-5d77156e9350 req-50caa469-fddc-444f-a446-4c5f70483657 tempest-AttachVolumeShelveTestJSON-810060241 tempest-AttachVolumeShelveTestJSON-810060241-project-member] Enqueued Resource ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 with Priority: HIGHEST for action security_group_members [ 1069.314560] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 with Priority: HIGHEST for action security_group_members [ 1069.314933] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.315076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.315127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.315386] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.315891] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.315891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.315891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.315891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.316085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.316085] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.751236] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.751572] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-988" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.751572] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-988" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.751853] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-988" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.752127] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.752288] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.752395] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.752632] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.752790] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.753079] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1069.753208] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1069.753319] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1069.753442] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1069.753572] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1069.753681] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1069.753828] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1069.779489] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1069.781162] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1069.781162] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1069.781162] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-988" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.781162] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-0a9176fd-1d2c-4b37-905d-594f595e4b4a taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.781162] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-0a9176fd-1d2c-4b37-905d-594f595e4b4a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.781162] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-0a9176fd-1d2c-4b37-905d-594f595e4b4a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.781162] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-0a9176fd-1d2c-4b37-905d-594f595e4b4a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.781498] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a9176fd-1d2c-4b37-905d-594f595e4b4a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.819841] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.820109] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.820154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.820392] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.820515] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.820740] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.821114] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.821114] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.821114] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.821245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.821270] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 already deleted. [ 1069.821361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.139762] env[66994]: INFO networking_nsxv3.common.synchronization [req-1bd749d2-ad71-4521-96a2-058a642d2f6a req-7ffc38cb-68e3-41dd-9b2f-c006376ba300 tempest-ServerDiskConfigTestJSON-2121377508 tempest-ServerDiskConfigTestJSON-2121377508-project-member] Enqueued Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 1070.140436] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 1070.140742] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.140890] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.140960] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.141200] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.141358] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.141455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.141512] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.141726] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.141726] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.141844] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.284059] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.284300] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.284435] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.284722] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.284871] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.285039] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 0a9176fd-1d2c-4b37-905d-594f595e4b4a not found, creating... [ 1070.285292] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.285438] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.285576] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.285811] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.285948] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.286246] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.286399] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.286514] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.286756] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.286898] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.287073] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 0a9176fd-1d2c-4b37-905d-594f595e4b4a is going to be created. [ 1070.316111] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.316895] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.316895] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.317071] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.317373] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.317688] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-0a9176fd-1d2c-4b37-905d-594f595e4b4a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.422284] env[66994]: INFO networking_nsxv3.common.synchronization [req-d4e13310-14bf-4ec9-8156-b93f24814251 req-4cf2c844-13ac-4b16-b0ae-3fe3cab81fd6 tempest-ImagesTestJSON-691407333 tempest-ImagesTestJSON-691407333-project-member] Enqueued Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 1070.422480] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e with Priority: HIGHEST for action security_group_members [ 1070.422881] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.422987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.423068] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.423267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.423419] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.423517] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.423578] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.423725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.423815] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.423905] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88bd36a2-b7c7-405c-ba4b-c36eb190f52e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.644050] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.644247] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.644321] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.644549] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.644640] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.644879] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.644987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.645070] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.645222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.645300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.645388] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 is going to be updated. [ 1070.673638] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.673765] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.673916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.674176] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.674328] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.683332] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: IN_PROGRESS for 2s [ 1070.928738] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.929017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.929017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.929192] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.929280] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.929490] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.929596] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.929658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.929808] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.929882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.929968] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e is going to be updated. [ 1070.958532] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.958695] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.958743] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.958943] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.959125] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.969573] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: IN_PROGRESS for 2s [ 1070.999984] env[66994]: INFO networking_nsxv3.common.synchronization [req-ea2eecf3-9477-42bd-8e1f-5d77156e9350 req-93884818-1695-4175-ad4f-bd65240e8ee5 service nova] Enqueued Resource ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 with Priority: HIGHEST for action security_group_rules [ 1071.000167] env[66994]: INFO networking_nsxv3.common.synchronization [req-ea2eecf3-9477-42bd-8e1f-5d77156e9350 req-93884818-1695-4175-ad4f-bd65240e8ee5 service nova] Enqueued Resource ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 with Priority: HIGHEST for action security_group_members [ 1071.000294] env[66994]: INFO networking_nsxv3.common.synchronization [req-ea2eecf3-9477-42bd-8e1f-5d77156e9350 req-93884818-1695-4175-ad4f-bd65240e8ee5 service nova] Enqueued Resource ID: 0a9176fd-1d2c-4b37-905d-594f595e4b4a with Priority: HIGHEST for action port [ 1071.000831] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 with Priority: HIGHEST for action security_group_rules [ 1071.000958] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 with Priority: HIGHEST for action security_group_members [ 1071.001329] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a9176fd-1d2c-4b37-905d-594f595e4b4a with Priority: HIGHEST for action port [ 1071.001659] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.001807] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.002431] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.002431] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.002431] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.003064] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.003204] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.003247] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.003792] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.003950] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.004085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.004158] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.005846] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.005846] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.005846] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.006147] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a9176fd-1d2c-4b37-905d-594f595e4b4a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.006324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a9176fd-1d2c-4b37-905d-594f595e4b4a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.006510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a9176fd-1d2c-4b37-905d-594f595e4b4a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.006510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a9176fd-1d2c-4b37-905d-594f595e4b4a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.006604] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a9176fd-1d2c-4b37-905d-594f595e4b4a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.307764] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: SUCCESS [ 1071.307935] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 deletion is rescheduled due to dependency. [ 1071.308136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.507215] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.508497] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.508620] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.508918] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a9176fd-1d2c-4b37-905d-594f595e4b4a with status ACTIVE [ 1071.509123] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.509243] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.509309] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.509504] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.509588] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.509747] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.509843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.509897] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.510259] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.510439] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.510597] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.510726] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.510804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.511095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.511095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.511767] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a9176fd-1d2c-4b37-905d-594f595e4b4a is going to be updated. [ 1071.540930] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.540930] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.540930] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.541200] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.541200] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.541296] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a9176fd-1d2c-4b37-905d-594f595e4b4a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.017910] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.520135] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.520308] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.520366] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.520583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.520671] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.520768] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 is going to be created. [ 1072.551501] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.551709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.551791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.552704] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.552797] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.565089] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 in Status: UNINITIALIZED for 2s [ 1072.695445] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: SUCCESS [ 1072.695632] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 deletion is rescheduled due to dependency. [ 1072.695748] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.737632] env[66994]: INFO networking_nsxv3.common.synchronization [req-25b3cb5d-9abe-4130-af0f-99f659b0db72 req-1588b233-6ee3-4ea6-984f-1700d59c094f tempest-ServersTestJSON-587851554 tempest-ServersTestJSON-587851554-project-member] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 1072.738280] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 1072.738605] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.738958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.738958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.738958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.739210] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.739440] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.739440] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.739553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.739681] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.739723] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.980272] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e in Status: SUCCESS [ 1072.980446] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88bd36a2-b7c7-405c-ba4b-c36eb190f52e deletion is rescheduled due to dependency. [ 1072.980574] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88bd36a2-b7c7-405c-ba4b-c36eb190f52e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.057587] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.057968] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.058033] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.058394] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.058686] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.058853] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.059045] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.059338] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.059519] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.059757] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.059882] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1073.059992] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1073.060121] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1073.060227] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.060332] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1073.060492] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1073.079875] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1073.080056] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1073.080176] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1073.080345] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-557" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.080652] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-b02b28fb-aa0e-4102-a838-d6c334c04fd6 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.080817] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-b02b28fb-aa0e-4102-a838-d6c334c04fd6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.080934] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-b02b28fb-aa0e-4102-a838-d6c334c04fd6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.081283] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-b02b28fb-aa0e-4102-a838-d6c334c04fd6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.081432] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b02b28fb-aa0e-4102-a838-d6c334c04fd6',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.243101] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.584855] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.585142] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.585275] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.585594] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.585744] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.585909] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port b02b28fb-aa0e-4102-a838-d6c334c04fd6 not found, creating... [ 1073.586241] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.586417] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.586534] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.586961] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.587166] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.587466] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.587629] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.588166] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.588166] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.588299] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.588527] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: b02b28fb-aa0e-4102-a838-d6c334c04fd6 is going to be created. [ 1073.621409] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.621615] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.621737] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.622017] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.622285] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.622569] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-b02b28fb-aa0e-4102-a838-d6c334c04fd6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.745372] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.247752] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.248107] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.248107] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.249583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.249583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.249583] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 1074.279808] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.280020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.280059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.280257] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.280403] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.290471] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 1074.331177] env[66994]: INFO networking_nsxv3.common.synchronization [req-25b3cb5d-9abe-4130-af0f-99f659b0db72 req-1dfa226f-f3d6-42c2-8556-07487c150533 service nova] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_rules [ 1074.331525] env[66994]: INFO networking_nsxv3.common.synchronization [req-25b3cb5d-9abe-4130-af0f-99f659b0db72 req-1dfa226f-f3d6-42c2-8556-07487c150533 service nova] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 1074.331777] env[66994]: INFO networking_nsxv3.common.synchronization [req-25b3cb5d-9abe-4130-af0f-99f659b0db72 req-1dfa226f-f3d6-42c2-8556-07487c150533 service nova] Enqueued Resource ID: b02b28fb-aa0e-4102-a838-d6c334c04fd6 with Priority: HIGHEST for action port [ 1074.332862] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_rules [ 1074.332862] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 1074.332862] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b02b28fb-aa0e-4102-a838-d6c334c04fd6 with Priority: HIGHEST for action port [ 1074.334016] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.334016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.334016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.334016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.334016] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.335170] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.335427] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.335690] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-b02b28fb-aa0e-4102-a838-d6c334c04fd6 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.335878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b02b28fb-aa0e-4102-a838-d6c334c04fd6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.335924] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b02b28fb-aa0e-4102-a838-d6c334c04fd6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.336130] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b02b28fb-aa0e-4102-a838-d6c334c04fd6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.336236] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b02b28fb-aa0e-4102-a838-d6c334c04fd6',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.576929] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 in Status: SUCCESS [ 1074.576929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.576929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.577327] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.577647] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.577902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.577999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.578360] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.578495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.578716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.578844] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.835944] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.836173] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.840430] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b02b28fb-aa0e-4102-a838-d6c334c04fd6 with status ACTIVE [ 1074.840430] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.840430] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.840430] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.840430] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.840430] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.840430] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.840686] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.840686] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.840686] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.840776] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.840897] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.840974] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.841401] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.841401] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.841401] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.841401] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b02b28fb-aa0e-4102-a838-d6c334c04fd6 is going to be updated. [ 1074.862977] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.863166] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.863205] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.863394] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.863526] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.863683] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b02b28fb-aa0e-4102-a838-d6c334c04fd6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.915980] env[66994]: INFO networking_nsxv3.common.synchronization [req-07e3b43f-e591-4e11-b944-c8839cf5d00f req-59230064-2ca4-44c4-afc5-b051e78e87c6 tempest-ServerActionsTestOtherA-355769928 tempest-ServerActionsTestOtherA-355769928-project-member] Enqueued Resource ID: 086f38af-0633-4270-b4b2-f416d2945ae1 with Priority: HIGHEST for action security_group_members [ 1074.916542] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 086f38af-0633-4270-b4b2-f416d2945ae1 with Priority: HIGHEST for action security_group_members [ 1074.916931] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-086f38af-0633-4270-b4b2-f416d2945ae1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.917146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.917214] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.917463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.917742] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.917742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.917876] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.917951] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.918049] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.918143] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('086f38af-0633-4270-b4b2-f416d2945ae1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.081844] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.239433] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-732 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.239584] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-732" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.239975] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-732" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.240279] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-732" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.240659] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.240823] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.240823] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.241097] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.241220] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.241414] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1075.241482] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1075.241585] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1075.241689] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1075.241819] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1075.241889] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1075.242032] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1075.265500] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1075.265794] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1075.265825] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1075.266027] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-732" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.266310] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-49727caa-62d2-4974-9e03-33e28b4bf6cf taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.266507] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-49727caa-62d2-4974-9e03-33e28b4bf6cf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.266614] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-49727caa-62d2-4974-9e03-33e28b4bf6cf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.267057] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-49727caa-62d2-4974-9e03-33e28b4bf6cf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.267155] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49727caa-62d2-4974-9e03-33e28b4bf6cf',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.420115] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.420239] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.420311] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.420725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.420725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.420909] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.421011] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.421154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.421224] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.421295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.421378] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 086f38af-0633-4270-b4b2-f416d2945ae1 already deleted. [ 1075.421479] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.584388] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9: rpc.has_security_group_logging(os_id): False [ 1075.604536] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.604536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.604536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.604774] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.604805] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.605241] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.605241] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.605241] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.605520] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.605520] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.605520] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 is going to be created. [ 1075.665741] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.665913] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.665957] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.666193] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.666438] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.678683] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 in Status: IN_PROGRESS for 2s [ 1075.770261] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.770454] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.770563] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.770885] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.771064] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.771280] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 49727caa-62d2-4974-9e03-33e28b4bf6cf not found, creating... [ 1075.771558] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.771726] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.771848] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.772090] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.772447] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.772517] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.772648] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.772759] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.772964] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.773156] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.773403] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 49727caa-62d2-4974-9e03-33e28b4bf6cf is going to be created. [ 1075.794078] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.794078] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.794078] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.794078] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.794078] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.794366] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-49727caa-62d2-4974-9e03-33e28b4bf6cf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.306630] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 1076.307012] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.307216] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.307446] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.307650] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.307774] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.307870] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.308118] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.308211] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.308312] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.500580] env[66994]: INFO networking_nsxv3.common.synchronization [req-07e3b43f-e591-4e11-b944-c8839cf5d00f req-7d95aca9-69b2-4636-97fe-45bcdb6ba6d2 service nova] Enqueued Resource ID: 086f38af-0633-4270-b4b2-f416d2945ae1 with Priority: HIGHEST for action security_group_rules [ 1076.501784] env[66994]: INFO networking_nsxv3.common.synchronization [req-07e3b43f-e591-4e11-b944-c8839cf5d00f req-7d95aca9-69b2-4636-97fe-45bcdb6ba6d2 service nova] Enqueued Resource ID: 086f38af-0633-4270-b4b2-f416d2945ae1 with Priority: HIGHEST for action security_group_members [ 1076.501784] env[66994]: INFO networking_nsxv3.common.synchronization [req-07e3b43f-e591-4e11-b944-c8839cf5d00f req-7d95aca9-69b2-4636-97fe-45bcdb6ba6d2 service nova] Enqueued Resource ID: 49727caa-62d2-4974-9e03-33e28b4bf6cf with Priority: HIGHEST for action port [ 1076.501784] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 086f38af-0633-4270-b4b2-f416d2945ae1 with Priority: HIGHEST for action security_group_rules [ 1076.501784] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 086f38af-0633-4270-b4b2-f416d2945ae1 with Priority: HIGHEST for action security_group_members [ 1076.501784] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49727caa-62d2-4974-9e03-33e28b4bf6cf with Priority: HIGHEST for action port [ 1076.502298] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-086f38af-0633-4270-b4b2-f416d2945ae1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.502499] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.502576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.502797] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.502878] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('086f38af-0633-4270-b4b2-f416d2945ae1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.504224] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-086f38af-0633-4270-b4b2-f416d2945ae1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.504698] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.504826] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.505085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.505279] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.505367] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.505367] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.505881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.505881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.505881] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('086f38af-0633-4270-b4b2-f416d2945ae1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.507842] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-49727caa-62d2-4974-9e03-33e28b4bf6cf taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.507842] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49727caa-62d2-4974-9e03-33e28b4bf6cf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.507842] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49727caa-62d2-4974-9e03-33e28b4bf6cf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.507842] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49727caa-62d2-4974-9e03-33e28b4bf6cf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.508190] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49727caa-62d2-4974-9e03-33e28b4bf6cf',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.810830] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.006466] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-086f38af-0633-4270-b4b2-f416d2945ae1 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.006466] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.016022] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('086f38af-0633-4270-b4b2-f416d2945ae1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.016022] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 49727caa-62d2-4974-9e03-33e28b4bf6cf with status ACTIVE [ 1077.016022] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.016022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.016022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.016022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.016022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.016022] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.016022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.016022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.016022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.016022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.016022] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.016022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.016022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.016022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.016884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.016884] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 49727caa-62d2-4974-9e03-33e28b4bf6cf is going to be updated. [ 1077.045841] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.046928] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.046928] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.046928] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.046928] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.046928] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49727caa-62d2-4974-9e03-33e28b4bf6cf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.313027] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.315671] env[66994]: INFO networking_nsxv3.common.synchronization [req-ad2c721f-c258-4bd1-a2a5-b8e69ce83dac req-ac7cd7bc-212f-4ca2-807b-a77c88ee83af tempest-ServerDiskConfigTestJSON-2121377508 tempest-ServerDiskConfigTestJSON-2121377508-project-member] Enqueued Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 1077.316331] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 1077.316641] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.316758] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.316827] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.317038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.317196] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.317297] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.317358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.317503] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.317592] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.317674] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.521274] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('086f38af-0633-4270-b4b2-f416d2945ae1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.616816] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-172 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.616816] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-172" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.616816] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-172" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.616816] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-172" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.616816] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.617209] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.617481] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.617816] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.619026] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.619026] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.619026] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.619026] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.619026] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.619026] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.619026] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.619266] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.643269] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.643269] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1077.643269] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.643269] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-172" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.643269] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-301cb946-80b9-4140-8145-85acff92d4d5 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.643269] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-301cb946-80b9-4140-8145-85acff92d4d5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.643269] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-301cb946-80b9-4140-8145-85acff92d4d5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.643269] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-301cb946-80b9-4140-8145-85acff92d4d5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.643269] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('301cb946-80b9-4140-8145-85acff92d4d5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.689726] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 in Status: SUCCESS [ 1077.689971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.816733] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.816942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.816979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.817229] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.817315] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.817417] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 1077.821041] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.821041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.821041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.821041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.821041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.821041] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.821041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.821349] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.821349] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.821349] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.821426] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 is going to be updated. [ 1077.855919] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.855919] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.856124] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.856245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.856399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.858387] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.858387] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.858387] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.858510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.858554] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.870573] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 1077.871207] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: IN_PROGRESS for 2s [ 1078.023027] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.023246] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.023299] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.023489] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.023581] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.023679] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 086f38af-0633-4270-b4b2-f416d2945ae1 is going to be created. [ 1078.048714] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.048714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.048714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.049027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.049184] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.059013] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 086f38af-0633-4270-b4b2-f416d2945ae1 in Status: UNINITIALIZED for 2s [ 1078.145437] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.145675] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.146457] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.146457] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.146457] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.146457] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 301cb946-80b9-4140-8145-85acff92d4d5 not found, creating... [ 1078.146606] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.146764] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.146905] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.147585] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.147585] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.147585] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.147708] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.147788] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.148167] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.148352] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.148526] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 301cb946-80b9-4140-8145-85acff92d4d5 is going to be created. [ 1078.167228] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.167440] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.167554] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.167995] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.168202] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.168473] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-301cb946-80b9-4140-8145-85acff92d4d5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.931540] env[66994]: INFO networking_nsxv3.common.synchronization [req-ad2c721f-c258-4bd1-a2a5-b8e69ce83dac req-d23fb982-52d7-4212-bba5-e258d5fb6fe4 service nova] Enqueued Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_rules [ 1078.931786] env[66994]: INFO networking_nsxv3.common.synchronization [req-ad2c721f-c258-4bd1-a2a5-b8e69ce83dac req-d23fb982-52d7-4212-bba5-e258d5fb6fe4 service nova] Enqueued Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 1078.931850] env[66994]: INFO networking_nsxv3.common.synchronization [req-ad2c721f-c258-4bd1-a2a5-b8e69ce83dac req-d23fb982-52d7-4212-bba5-e258d5fb6fe4 service nova] Enqueued Resource ID: 301cb946-80b9-4140-8145-85acff92d4d5 with Priority: HIGHEST for action port [ 1078.932388] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_rules [ 1078.932497] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 1078.934337] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 301cb946-80b9-4140-8145-85acff92d4d5 with Priority: HIGHEST for action port [ 1078.934700] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.935291] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.935291] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.935291] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.935291] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.937042] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.937832] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.937832] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-301cb946-80b9-4140-8145-85acff92d4d5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.937832] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-301cb946-80b9-4140-8145-85acff92d4d5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.937832] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-301cb946-80b9-4140-8145-85acff92d4d5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.938289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-301cb946-80b9-4140-8145-85acff92d4d5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.939030] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('301cb946-80b9-4140-8145-85acff92d4d5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.440141] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.440305] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.440511] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 301cb946-80b9-4140-8145-85acff92d4d5 with status ACTIVE [ 1079.440747] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.440844] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.440875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.441091] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.441191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.441345] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.441442] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.441495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.441652] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.441726] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.441908] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.441989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.442093] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.442202] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.442274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.442355] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 301cb946-80b9-4140-8145-85acff92d4d5 is going to be updated. [ 1079.464069] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.464221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.464289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.464505] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.464650] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.464975] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-301cb946-80b9-4140-8145-85acff92d4d5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.882800] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: SUCCESS [ 1079.882994] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 deletion is rescheduled due to dependency. [ 1079.883480] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.883480] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.883480] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.883877] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.883877] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.883877] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.883980] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.884050] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.884147] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.885643] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 1079.885904] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.885978] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.886163] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.886330] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.886434] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.886498] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.886637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.886714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.886797] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.886947] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.069911] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 086f38af-0633-4270-b4b2-f416d2945ae1 in Status: SUCCESS [ 1080.070261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.070456] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.071026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.071026] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.071156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.071203] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.071377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.071467] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.071558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.071658] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('086f38af-0633-4270-b4b2-f416d2945ae1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.388541] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.389699] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.389858] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.389940] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.390193] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.390382] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.390490] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.390558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.390755] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.390905] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.391170] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.391225] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.391310] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.391365] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.391507] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.394089] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.394220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.394369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.395612] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.395612] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.395612] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.395612] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.573718] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('086f38af-0633-4270-b4b2-f416d2945ae1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.897827] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.903505] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8: rpc.has_security_group_logging(os_id): False [ 1080.926454] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.926629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.926709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.927017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.927130] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.927355] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.927460] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.927548] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.927720] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.927784] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.927996] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.928085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.928122] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.928277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.928351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.928574] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.928699] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.928764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.928912] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.928990] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.929823] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 1081.007507] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.007507] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.007507] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.008135] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.008373] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.027228] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 1081.076688] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 086f38af-0633-4270-b4b2-f416d2945ae1: rpc.has_security_group_logging(os_id): False [ 1081.097906] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.098156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.098235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.098517] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.098587] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.098821] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.098919] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.098982] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.099149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.099227] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.099400] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 086f38af-0633-4270-b4b2-f416d2945ae1 is going to be created. [ 1081.211164] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.211164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.211164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.211164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.211164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.228926] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 086f38af-0633-4270-b4b2-f416d2945ae1 in Status: IN_PROGRESS for 2s [ 1081.409172] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.409172] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.409172] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.409172] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.409172] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.409172] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 is going to be updated. [ 1081.451950] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.452086] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.452204] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.452427] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.452573] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.467028] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: IN_PROGRESS for 2s [ 1082.159330] env[66994]: INFO networking_nsxv3.common.synchronization [req-1bf96142-8560-480d-bb02-80be551cadc6 req-e2b38b54-0914-4e33-ac45-babf35dfca98 tempest-AttachVolumeNegativeTest-1341698298 tempest-AttachVolumeNegativeTest-1341698298-project-member] Enqueued Resource ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 with Priority: HIGHEST for action security_group_members [ 1082.159764] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 with Priority: HIGHEST for action security_group_members [ 1082.160096] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-705505ff-4cd1-493a-b249-a5178fb4ee23 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.160227] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.160340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.160507] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.160678] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.160771] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.160848] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.161052] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.161143] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.161297] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('705505ff-4cd1-493a-b249-a5178fb4ee23',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.664469] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.664925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.664925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.664925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.665106] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.665219] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.665342] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.665420] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.665603] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.665706] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.665774] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 is going to be updated. [ 1082.695533] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.697646] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.697646] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.697646] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.697646] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.710522] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 in Status: IN_PROGRESS for 2s [ 1083.042999] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 1083.042999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.241075] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 086f38af-0633-4270-b4b2-f416d2945ae1 in Status: SUCCESS [ 1083.241075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.480602] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: SUCCESS [ 1083.480897] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.481183] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.481472] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.481682] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.481852] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.481925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.482108] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.482189] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.482294] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.482428] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.985536] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.985737] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.985807] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.986125] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.986351] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.986455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.986534] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.986697] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.986847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.986978] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.987146] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.987235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.987594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.987594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.987875] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.988345] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.988345] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.988345] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.988345] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.988345] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.988606] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.098979] env[66994]: INFO networking_nsxv3.common.synchronization [req-19d23a35-75c3-4fa0-b5a6-e10042aecaae req-43e07101-9683-44ed-bf8c-ec5d653e1705 tempest-AttachInterfacesTestJSON-1437683655 tempest-AttachInterfacesTestJSON-1437683655-project-member] Enqueued Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1084.099218] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1084.099526] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.099645] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.099712] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.099967] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.100172] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.100259] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.100321] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.100470] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.100555] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.100648] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.360058] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.360058] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.360058] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.360058] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.360493] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.360493] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.360651] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.360865] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.361112] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.361361] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1084.361521] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1084.361669] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1084.361819] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1084.361978] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1084.362150] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1084.362324] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1084.381986] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1084.382138] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1084.382310] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1084.382513] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.382861] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-adc6febe-948d-4d84-b497-af16bdf0dab5 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.383081] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-adc6febe-948d-4d84-b497-af16bdf0dab5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.383280] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-adc6febe-948d-4d84-b497-af16bdf0dab5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.383624] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-adc6febe-948d-4d84-b497-af16bdf0dab5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.383790] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adc6febe-948d-4d84-b497-af16bdf0dab5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.490140] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b62a4f35-964f-404b-ba36-70b4e8cb2dc5: rpc.has_security_group_logging(os_id): False [ 1084.511409] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.512344] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.512344] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.512344] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.512344] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.512504] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.512504] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.512590] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.512770] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.512887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.513708] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.513708] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.513708] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.513708] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.513708] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.513907] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.514218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.514218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.514329] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.514592] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.514592] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 is going to be updated. [ 1084.590741] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.590958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.591056] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.591328] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.591503] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.602625] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.602867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.602867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.603151] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.603261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.603472] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.603603] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.603649] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.603820] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.603916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.604023] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa already deleted. [ 1084.604144] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.618421] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: IN_PROGRESS for 2s [ 1084.724245] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 in Status: SUCCESS [ 1084.724585] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 deletion is rescheduled due to dependency. [ 1084.724727] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.886507] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.886747] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.886873] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.887270] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.887407] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.887567] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port adc6febe-948d-4d84-b497-af16bdf0dab5 not found, creating... [ 1084.887827] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.888042] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.888166] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.888392] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.888533] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.888815] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.888990] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.889111] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.889325] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.889478] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.889610] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: adc6febe-948d-4d84-b497-af16bdf0dab5 is going to be created. [ 1084.912126] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.912420] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.912497] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.912773] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.913090] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.913329] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-adc6febe-948d-4d84-b497-af16bdf0dab5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.598745] env[66994]: INFO networking_nsxv3.common.synchronization [req-19d23a35-75c3-4fa0-b5a6-e10042aecaae req-19d2c18e-9d99-484c-b1c5-6431816616c9 service nova] Enqueued Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_rules [ 1085.599059] env[66994]: INFO networking_nsxv3.common.synchronization [req-19d23a35-75c3-4fa0-b5a6-e10042aecaae req-19d2c18e-9d99-484c-b1c5-6431816616c9 service nova] Enqueued Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1085.599059] env[66994]: INFO networking_nsxv3.common.synchronization [req-19d23a35-75c3-4fa0-b5a6-e10042aecaae req-19d2c18e-9d99-484c-b1c5-6431816616c9 service nova] Enqueued Resource ID: adc6febe-948d-4d84-b497-af16bdf0dab5 with Priority: HIGHEST for action port [ 1085.599588] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_rules [ 1085.599718] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1085.599816] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adc6febe-948d-4d84-b497-af16bdf0dab5 with Priority: HIGHEST for action port [ 1085.600563] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.600713] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.600772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.601054] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.601142] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.602874] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.603022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.603089] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.604261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.604261] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.604261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.604261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.604261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.604261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.604576] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.607151] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-adc6febe-948d-4d84-b497-af16bdf0dab5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.607151] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adc6febe-948d-4d84-b497-af16bdf0dab5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.607151] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adc6febe-948d-4d84-b497-af16bdf0dab5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.607151] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adc6febe-948d-4d84-b497-af16bdf0dab5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.607151] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adc6febe-948d-4d84-b497-af16bdf0dab5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.104071] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.104209] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.106595] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.108162] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port adc6febe-948d-4d84-b497-af16bdf0dab5 with status ACTIVE [ 1086.108607] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.108607] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.108607] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.108744] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.108830] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.108986] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.109445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.109445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.109445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.109445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.109581] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.109630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.109748] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.109861] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.109891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.110268] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: adc6febe-948d-4d84-b497-af16bdf0dab5 is going to be updated. [ 1086.133469] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.133469] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.133469] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.133469] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.133693] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.133878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adc6febe-948d-4d84-b497-af16bdf0dab5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.608546] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.633225] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: SUCCESS [ 1086.633456] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.111458] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.111668] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.111745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.111976] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.112091] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.112195] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa is going to be created. [ 1087.138141] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.138141] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.138141] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.138403] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.138571] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.148259] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: UNINITIALIZED for 2s [ 1088.157754] env[66994]: INFO networking_nsxv3.common.synchronization [req-0d908beb-bf9a-4a26-9612-466978dcddd4 req-631eda74-1e3d-4104-a8dd-b4653b7b498f tempest-DeleteServersTestJSON-15988793 tempest-DeleteServersTestJSON-15988793-project-member] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1088.158605] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1088.159248] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.159442] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.159550] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.159886] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.160235] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.160427] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.160542] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.160795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.160910] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.161047] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.357793] env[66994]: INFO networking_nsxv3.common.synchronization [req-a80883f1-d2f5-48ec-8702-0d901212d449 req-96032d7e-20ae-4006-9351-48c04b718281 tempest-ServersTestJSON-587851554 tempest-ServersTestJSON-587851554-project-member] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 1088.358114] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 1088.358439] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.358552] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.358721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.358818] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.358984] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.359575] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.359663] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.359832] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.360328] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.360471] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.518144] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-160 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.518308] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.518393] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.518767] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.520654] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.520979] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.521168] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.522267] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.522267] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.522267] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1088.522696] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1088.528299] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1088.528299] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1088.528299] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1088.528299] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1088.528299] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1088.579835] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1088.580264] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.052 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1088.580484] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1088.580739] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.581266] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-d83a528c-d897-47fc-be25-f56076577126 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.581575] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-d83a528c-d897-47fc-be25-f56076577126" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.582318] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-d83a528c-d897-47fc-be25-f56076577126" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.582848] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-d83a528c-d897-47fc-be25-f56076577126" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.583154] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d83a528c-d897-47fc-be25-f56076577126',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.663400] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.663600] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.663701] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.663967] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.664118] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.664322] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.664849] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.664849] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.664849] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.664849] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.664849] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be updated. [ 1088.690847] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.691012] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.691052] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.691711] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.691711] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.700712] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: IN_PROGRESS for 2s [ 1088.863274] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.085933] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.086205] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.086297] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.086599] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.086760] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.086913] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port d83a528c-d897-47fc-be25-f56076577126 not found, creating... [ 1089.087242] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.087407] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.087524] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.087769] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.087994] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.088299] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.088465] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.088598] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.088826] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.088960] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.089129] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: d83a528c-d897-47fc-be25-f56076577126 is going to be created. [ 1089.122682] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.122941] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.123020] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.123333] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.123565] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.123795] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-d83a528c-d897-47fc-be25-f56076577126" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.161842] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: SUCCESS [ 1089.162104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.162295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.162564] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.162700] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.162818] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.162887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.163066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.163154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.163233] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.163320] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.365895] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.667748] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.667971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.668104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.668405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.668641] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.668780] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.668881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.669140] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.669307] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.669406] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.669616] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.669728] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.669810] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.669991] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.670184] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.670309] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.670391] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.670569] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.670671] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.670778] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.670896] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.825692] env[66994]: INFO networking_nsxv3.common.synchronization [req-0d908beb-bf9a-4a26-9612-466978dcddd4 req-bb31f5f7-c536-42d5-a695-9a09584a42d0 service nova] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_rules [ 1089.825911] env[66994]: INFO networking_nsxv3.common.synchronization [req-0d908beb-bf9a-4a26-9612-466978dcddd4 req-bb31f5f7-c536-42d5-a695-9a09584a42d0 service nova] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1089.826231] env[66994]: INFO networking_nsxv3.common.synchronization [req-0d908beb-bf9a-4a26-9612-466978dcddd4 req-bb31f5f7-c536-42d5-a695-9a09584a42d0 service nova] Enqueued Resource ID: d83a528c-d897-47fc-be25-f56076577126 with Priority: HIGHEST for action port [ 1089.826710] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_rules [ 1089.826865] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1089.827213] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d83a528c-d897-47fc-be25-f56076577126 with Priority: HIGHEST for action port [ 1089.827658] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.827818] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.827912] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.828176] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.828268] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.829841] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.829841] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.830070] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-d83a528c-d897-47fc-be25-f56076577126 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.830274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d83a528c-d897-47fc-be25-f56076577126" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.830274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d83a528c-d897-47fc-be25-f56076577126" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.830414] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d83a528c-d897-47fc-be25-f56076577126" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.830491] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d83a528c-d897-47fc-be25-f56076577126',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.869147] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.869363] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.869438] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.869604] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.869735] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.869799] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 1089.903624] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.903785] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.903842] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.904059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.904208] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.915251] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 1090.173155] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b740b91b-8f03-45e7-909b-66803d9ffafa: rpc.has_security_group_logging(os_id): False [ 1090.193480] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.193686] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.193686] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.193913] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.194048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.194286] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.194286] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.194429] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.194503] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.194577] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.194765] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.195025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.195025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.195192] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.195561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.195561] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.195561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.195722] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.195722] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.195801] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.195877] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa is going to be created. [ 1090.261258] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.261461] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.261461] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.261683] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.261863] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.273337] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: IN_PROGRESS for 2s [ 1090.330519] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.330519] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.335939] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d83a528c-d897-47fc-be25-f56076577126 with status ACTIVE [ 1090.335939] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.335939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.335939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.335939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.335939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.335939] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.335939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.335939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.335939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.335939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.335939] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.335939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.335939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.335939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.335939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.335939] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d83a528c-d897-47fc-be25-f56076577126 is going to be updated. [ 1090.370330] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.370330] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.370330] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.370589] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.371941] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.371941] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d83a528c-d897-47fc-be25-f56076577126" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.408318] env[66994]: INFO networking_nsxv3.common.synchronization [req-4557401c-e114-4d6b-8698-612c1fe931f1 req-e2b721be-7497-4711-90ad-f7af320c67db tempest-ServerDiskConfigTestJSON-2121377508 tempest-ServerDiskConfigTestJSON-2121377508-project-member] Enqueued Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 1090.409197] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGHEST for action security_group_members [ 1090.409323] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.409677] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.409677] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.409778] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.409884] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.409976] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.410051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.410202] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.410542] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.410542] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.715373] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: SUCCESS [ 1090.715570] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 deletion is rescheduled due to dependency. [ 1090.715681] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.715951] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.716363] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.716457] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.716618] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.716705] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.716880] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.717050] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.717228] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.913205] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.913205] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.913484] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.913696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.914078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.915127] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.915127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.915127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.915127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.915127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.915127] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 is going to be updated. [ 1090.950611] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.950843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.950843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.951856] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.951856] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.961158] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: IN_PROGRESS for 2s [ 1091.219153] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.503024] env[66994]: INFO networking_nsxv3.common.synchronization [req-de37836d-1ab4-4d8c-b871-76f89d5eac22 req-b5b8f196-0c5c-406f-b298-ae12f8b72020 tempest-ServerRescueNegativeTestJSON-420933347 tempest-ServerRescueNegativeTestJSON-420933347-project-member] Enqueued Resource ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 with Priority: HIGHEST for action security_group_members [ 1091.503024] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 with Priority: HIGHEST for action security_group_members [ 1091.503024] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e887c3d4-547e-480b-bd4c-f503fcb02ca5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.503024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.503024] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.503805] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.504084] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.504331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.504491] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.504737] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.504938] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.505267] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e887c3d4-547e-480b-bd4c-f503fcb02ca5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.721924] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.932236] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 1091.932521] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.008097] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.008334] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.008435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.008596] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.042418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.042749] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.042888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.043008] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.043342] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.043703] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.043908] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 is going to be updated. [ 1092.080793] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.080967] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.081058] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.081291] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.081466] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.091280] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 in Status: IN_PROGRESS for 2s [ 1092.224487] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.224782] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.224782] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.224956] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.225583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.225583] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be updated. [ 1092.255202] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.255389] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.255444] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.255625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.255831] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.268524] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: IN_PROGRESS for 2s [ 1092.311826] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: SUCCESS [ 1092.311826] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.973075] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 in Status: SUCCESS [ 1092.973253] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 deletion is rescheduled due to dependency. [ 1092.973324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.101924] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 in Status: SUCCESS [ 1094.101924] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e887c3d4-547e-480b-bd4c-f503fcb02ca5 deletion is rescheduled due to dependency. [ 1094.102301] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e887c3d4-547e-480b-bd4c-f503fcb02ca5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.279843] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: SUCCESS [ 1094.279843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.279843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.280146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.280341] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.280494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.280568] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.280742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.280829] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.280917] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.281031] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.531430] env[66994]: INFO networking_nsxv3.common.synchronization [None req-36309959-ff83-4810-bd71-408aedc65d05 tempest-ServerActionsTestJSON-501116813 tempest-ServerActionsTestJSON-501116813-project-member] Enqueued Resource ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf with Priority: HIGHEST for action security_group_rules [ 1094.532374] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf with Priority: HIGHEST for action security_group_rules [ 1094.532758] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fc519de-4252-44ff-ace7-b0a5f3000ccf taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.532936] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.533035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.533487] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.533785] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fc519de-4252-44ff-ace7-b0a5f3000ccf',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.644877] env[66994]: INFO networking_nsxv3.common.synchronization [None req-4a280771-de99-4d49-911f-c8343a1dee06 tempest-ServerActionsTestJSON-501116813 tempest-ServerActionsTestJSON-501116813-project-member] Enqueued Resource ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf with Priority: HIGHEST for action security_group_rules [ 1094.645104] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf with Priority: HIGHEST for action security_group_rules [ 1094.645451] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fc519de-4252-44ff-ace7-b0a5f3000ccf taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.645785] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.783100] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.783322] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.783364] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.783709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.783923] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.784116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.784259] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.784476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.784610] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.784738] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.784919] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.785042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.785185] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.785402] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.785526] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.785645] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.785707] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.786009] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.786009] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.786009] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.786161] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.057622] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.057878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.057878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.058032] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.058097] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.058216] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf already deleted. [ 1095.058308] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.058461] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.058629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.058708] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fc519de-4252-44ff-ace7-b0a5f3000ccf',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.288420] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0030483-0783-4db3-971a-f3155da229b7: rpc.has_security_group_logging(os_id): False [ 1095.291017] env[66994]: INFO networking_nsxv3.common.synchronization [req-9928201e-3222-4b15-ba53-346292ed04e7 req-7d26b5c5-9f86-404c-9fb0-9b7272a5a2a4 tempest-ServersTestJSON-587851554 tempest-ServersTestJSON-587851554-project-member] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 1095.292216] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGHEST for action security_group_members [ 1095.292941] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.293692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.293692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.293812] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.293911] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.294043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.294092] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.294242] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.294330] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.294433] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.314813] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.314813] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.314813] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.315074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.315236] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.315438] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.315561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.315597] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.315754] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.315830] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.316483] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.316483] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.316653] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.316814] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.316890] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.317124] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.317214] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.317274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.317413] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.317482] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.317563] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be updated. [ 1095.392297] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.392297] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.392297] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.392297] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.392297] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.413861] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: IN_PROGRESS for 2s [ 1095.585667] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.586175] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.586450] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.586920] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.587143] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.587396] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf already deleted. [ 1095.587527] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.798107] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.798361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.798476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.798740] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.798904] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.799174] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.799426] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.799509] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.799686] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.799768] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.799857] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be updated. [ 1095.832204] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.832415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.832458] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.832652] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.832794] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.843142] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: IN_PROGRESS for 2s [ 1097.439225] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: SUCCESS [ 1097.439685] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.853392] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 in Status: SUCCESS [ 1097.853581] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 deletion is rescheduled due to dependency. [ 1097.853697] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.192435] env[66994]: INFO networking_nsxv3.common.synchronization [req-4d0661e3-d2c6-4cbe-ab2b-dbee7567856a req-e4a92f43-d79b-4f96-b372-42f9a99d720e tempest-AttachVolumeNegativeTest-1341698298 tempest-AttachVolumeNegativeTest-1341698298-project-member] Enqueued Resource ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f with Priority: HIGHEST for action security_group_members [ 1098.192978] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f with Priority: HIGHEST for action security_group_members [ 1098.193340] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.193451] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.193500] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.193731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.193886] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.193982] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.194054] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.194207] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.194287] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.194376] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dbf99f5-e2f2-4d4a-a2c0-855c798d247f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.562963] env[66994]: INFO networking_nsxv3.common.synchronization [req-9a3198e3-584f-47ae-9af7-58a866718c8f req-95dd5dc5-da62-480f-ad7d-6d39aedfd9be tempest-AttachInterfacesTestJSON-1437683655 tempest-AttachInterfacesTestJSON-1437683655-project-member] Enqueued Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1098.562963] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1098.564212] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.564212] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.564212] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.564212] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.564212] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.564500] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.564500] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.566081] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.566081] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.566081] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.697548] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.697758] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.697818] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.698021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.698096] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.698329] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.698455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.698509] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.698650] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.698725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.698776] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f is going to be updated. [ 1098.729847] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.730135] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.730135] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.730371] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.730448] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.740586] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f in Status: IN_PROGRESS for 2s [ 1099.068525] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.068678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.068750] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.068968] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.069077] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.069283] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.069371] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.069445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.069615] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.069693] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.069780] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa is going to be updated. [ 1099.098210] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.099046] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.099046] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.099046] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.099046] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.108065] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: IN_PROGRESS for 2s [ 1100.752568] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f in Status: SUCCESS [ 1100.752887] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f deletion is rescheduled due to dependency. [ 1100.752922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.118506] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: SUCCESS [ 1101.118685] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa deletion is rescheduled due to dependency. [ 1101.118798] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.474786] env[66994]: INFO networking_nsxv3.common.synchronization [req-14c86165-9513-419e-9d5c-ad3939782cf2 req-0ea3049b-3efc-4b48-8f49-2ca2f19da8dc tempest-AttachInterfacesTestJSON-1437683655 tempest-AttachInterfacesTestJSON-1437683655-project-member] Enqueued Resource ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 with Priority: HIGHEST for action security_group_members [ 1101.475377] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 with Priority: HIGHEST for action security_group_members [ 1101.475681] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab40fd20-8903-42f0-a8a2-66a0ed5248f4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.475802] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.475869] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.476078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.476230] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.476349] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.476400] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.476529] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.476610] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.476703] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab40fd20-8903-42f0-a8a2-66a0ed5248f4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.806678] env[66994]: INFO networking_nsxv3.common.synchronization [req-b644d08d-db4e-4edc-8c85-43a052247230 req-87348f23-3bb7-43e3-aa96-98f3b5af761b tempest-ServerActionsTestJSON-501116813 tempest-ServerActionsTestJSON-501116813-project-member] Enqueued Resource ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf with Priority: HIGHEST for action security_group_members [ 1101.807316] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf with Priority: HIGHEST for action security_group_members [ 1101.807636] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fc519de-4252-44ff-ace7-b0a5f3000ccf taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.807763] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.807831] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.808106] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.808290] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.808394] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.808458] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.808613] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.808697] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.808790] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fc519de-4252-44ff-ace7-b0a5f3000ccf',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.979469] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.980981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.981390] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.982254] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.982496] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.982831] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.983075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.984265] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.984459] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.984669] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.984790] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 is going to be updated. [ 1102.026878] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.027490] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.027657] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.027977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.028277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.037913] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 in Status: IN_PROGRESS for 2s [ 1102.191532] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-736 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.191975] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-736" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.192116] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-736" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.192380] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-736" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.192639] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.192791] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.192901] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.194071] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.194071] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.194071] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1102.194071] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1102.194071] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1102.194071] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1102.194071] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1102.194949] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1102.194949] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1102.214836] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1102.214836] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1102.214836] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1102.214836] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-736" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.215142] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-91e369d5-eaa3-412c-bda0-3421fbd2b0ff taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.215297] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-91e369d5-eaa3-412c-bda0-3421fbd2b0ff" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.215414] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-91e369d5-eaa3-412c-bda0-3421fbd2b0ff" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.215777] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-91e369d5-eaa3-412c-bda0-3421fbd2b0ff" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.215924] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91e369d5-eaa3-412c-bda0-3421fbd2b0ff',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.311227] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.311740] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.312611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.312611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.312611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.312763] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.313642] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.313642] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.313642] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.313642] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.313642] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf already deleted. [ 1102.313642] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.719063] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.719407] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.719625] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.720021] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.720240] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.720451] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 91e369d5-eaa3-412c-bda0-3421fbd2b0ff not found, creating... [ 1102.720889] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.721096] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.721257] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.721926] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.721926] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.722418] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.722776] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.723011] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.723317] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.723508] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.723701] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 91e369d5-eaa3-412c-bda0-3421fbd2b0ff is going to be created. [ 1102.754146] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.754424] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.754591] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.754904] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.755472] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.755472] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-91e369d5-eaa3-412c-bda0-3421fbd2b0ff" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.342188] env[66994]: INFO networking_nsxv3.common.synchronization [req-2def957b-ac69-403c-bfc1-b6ff6a23df50 req-4befbff2-07ed-40a2-a7f0-c49a393321df tempest-ServerRescueNegativeTestJSON-420933347 tempest-ServerRescueNegativeTestJSON-420933347-project-member] Enqueued Resource ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d with Priority: HIGHEST for action security_group_members [ 1103.343032] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d with Priority: HIGHEST for action security_group_members [ 1103.343605] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c718081-e5df-4901-a082-56a5b8ccbf2d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.343861] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.343996] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.344342] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.344623] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.344848] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.345017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.345327] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.345537] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.345766] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.476730] env[66994]: INFO networking_nsxv3.common.synchronization [req-b644d08d-db4e-4edc-8c85-43a052247230 req-8e457d06-d56c-4ed4-b793-25eb05697519 service nova] Enqueued Resource ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf with Priority: HIGHEST for action security_group_rules [ 1103.476906] env[66994]: INFO networking_nsxv3.common.synchronization [req-b644d08d-db4e-4edc-8c85-43a052247230 req-8e457d06-d56c-4ed4-b793-25eb05697519 service nova] Enqueued Resource ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf with Priority: HIGHEST for action security_group_members [ 1103.477057] env[66994]: INFO networking_nsxv3.common.synchronization [req-b644d08d-db4e-4edc-8c85-43a052247230 req-8e457d06-d56c-4ed4-b793-25eb05697519 service nova] Enqueued Resource ID: 91e369d5-eaa3-412c-bda0-3421fbd2b0ff with Priority: HIGHEST for action port [ 1103.477622] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf with Priority: HIGHEST for action security_group_rules [ 1103.477770] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf with Priority: HIGHEST for action security_group_members [ 1103.477848] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91e369d5-eaa3-412c-bda0-3421fbd2b0ff with Priority: HIGHEST for action port [ 1103.478518] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fc519de-4252-44ff-ace7-b0a5f3000ccf taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.478763] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.478884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.479252] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.479433] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fc519de-4252-44ff-ace7-b0a5f3000ccf',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.480573] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fc519de-4252-44ff-ace7-b0a5f3000ccf taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.481250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.481250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.481250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.481250] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.481611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.481611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.481881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.482349] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.482349] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fc519de-4252-44ff-ace7-b0a5f3000ccf',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.483499] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-91e369d5-eaa3-412c-bda0-3421fbd2b0ff taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.483850] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91e369d5-eaa3-412c-bda0-3421fbd2b0ff" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.483850] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91e369d5-eaa3-412c-bda0-3421fbd2b0ff" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.484044] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91e369d5-eaa3-412c-bda0-3421fbd2b0ff" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.484199] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91e369d5-eaa3-412c-bda0-3421fbd2b0ff',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.848631] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.985953] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fc519de-4252-44ff-ace7-b0a5f3000ccf taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.986107] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.986301] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fc519de-4252-44ff-ace7-b0a5f3000ccf',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.987259] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91e369d5-eaa3-412c-bda0-3421fbd2b0ff with status ACTIVE [ 1103.987453] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.987577] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.987653] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.987861] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.987950] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.988135] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.988242] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.988339] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.988613] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.988730] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.988921] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.989029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.989088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.989224] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.989294] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.989382] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91e369d5-eaa3-412c-bda0-3421fbd2b0ff is going to be updated. [ 1104.011757] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.011958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.012012] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.012217] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.012373] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.012536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91e369d5-eaa3-412c-bda0-3421fbd2b0ff" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.048241] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 in Status: SUCCESS [ 1104.048511] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 deletion is rescheduled due to dependency. [ 1104.048639] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.224131] env[66994]: INFO networking_nsxv3.common.synchronization [None req-42213ed9-21d1-41e0-8983-48d0fb5a73c0 tempest-AttachVolumeNegativeTest-1341698298 tempest-AttachVolumeNegativeTest-1341698298-project-member] Enqueued Resource ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 with Priority: HIGHEST for action security_group_rules [ 1104.224632] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 with Priority: HIGHEST for action security_group_rules [ 1104.224924] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.225061] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.225157] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.225378] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.225461] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.296424] env[66994]: INFO networking_nsxv3.common.synchronization [None req-1093751d-23a1-466d-9f8c-c3c8bd0d36ef tempest-AttachVolumeNegativeTest-1341698298 tempest-AttachVolumeNegativeTest-1341698298-project-member] Enqueued Resource ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 with Priority: HIGHEST for action security_group_rules [ 1104.296925] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 with Priority: HIGHEST for action security_group_rules [ 1104.297250] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.297396] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.351453] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.492022] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fc519de-4252-44ff-ace7-b0a5f3000ccf',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.745637] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.745786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.745872] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.746120] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.746232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.746344] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 already deleted. [ 1104.746448] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.746627] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.746809] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.746909] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.856136] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.856136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.856136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.856136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.856136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.856136] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d is going to be updated. [ 1104.884155] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.885020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.885020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.885020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.885311] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.895656] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d in Status: IN_PROGRESS for 2s [ 1104.994839] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.995080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.995080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.995388] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.995483] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.995589] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf is going to be created. [ 1105.027097] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.027322] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.027422] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.027643] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.027814] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.036995] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf in Status: UNINITIALIZED for 2s [ 1105.275930] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.276142] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.276142] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.276366] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.276452] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.276550] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 already deleted. [ 1105.276632] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.486218] env[66994]: INFO networking_nsxv3.common.synchronization [None req-9ce83252-35a8-489b-88bf-6d3ae0f6e08d tempest-AttachInterfacesTestJSON-1437683655 tempest-AttachInterfacesTestJSON-1437683655-project-member] Enqueued Resource ID: 661b2c26-8339-44c8-bda6-1d75548802e0 with Priority: HIGHEST for action security_group_rules [ 1106.487088] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 661b2c26-8339-44c8-bda6-1d75548802e0 with Priority: HIGHEST for action security_group_rules [ 1106.487466] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-661b2c26-8339-44c8-bda6-1d75548802e0 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.487611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.487659] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.487902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.487990] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('661b2c26-8339-44c8-bda6-1d75548802e0',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.573351] env[66994]: INFO networking_nsxv3.common.synchronization [None req-8322651a-2561-45a3-b87e-4ef9cd086a20 tempest-AttachInterfacesTestJSON-1437683655 tempest-AttachInterfacesTestJSON-1437683655-project-member] Enqueued Resource ID: 661b2c26-8339-44c8-bda6-1d75548802e0 with Priority: HIGHEST for action security_group_rules [ 1106.573351] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 661b2c26-8339-44c8-bda6-1d75548802e0 with Priority: HIGHEST for action security_group_rules [ 1106.573547] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-661b2c26-8339-44c8-bda6-1d75548802e0 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.573629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.909439] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d in Status: SUCCESS [ 1106.909701] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.009776] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.009932] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.009986] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.011047] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.011047] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.011047] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 661b2c26-8339-44c8-bda6-1d75548802e0 already deleted. [ 1107.011047] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.011047] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.011047] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.011047] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('661b2c26-8339-44c8-bda6-1d75548802e0',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.047788] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf in Status: SUCCESS [ 1107.048051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.048218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.048461] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.048656] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.048770] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.048833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.048986] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.049081] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.049166] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.049256] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fc519de-4252-44ff-ace7-b0a5f3000ccf',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.533582] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.533863] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.533863] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.534097] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.534268] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.534501] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 661b2c26-8339-44c8-bda6-1d75548802e0 already deleted. [ 1107.534501] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.552114] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fc519de-4252-44ff-ace7-b0a5f3000ccf',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.054352] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fc519de-4252-44ff-ace7-b0a5f3000ccf: rpc.has_security_group_logging(os_id): False [ 1108.073595] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.073595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.073804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.073978] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.074086] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.074347] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.074445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.074891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.074891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.074891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.074891] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf is going to be created. [ 1108.149243] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.149384] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.149466] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.149722] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.150104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.161650] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf in Status: IN_PROGRESS for 2s [ 1110.177983] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf in Status: SUCCESS [ 1110.178301] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.212361] env[66994]: INFO networking_nsxv3.common.synchronization [req-8d68d6ab-4730-4f73-8a0f-41668237f555 req-8a0b5634-6e4b-4891-93dc-b3f5d4e8500d tempest-ServerRescueNegativeTestJSON-420933347 tempest-ServerRescueNegativeTestJSON-420933347-project-member] Enqueued Resource ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d with Priority: HIGHEST for action security_group_members [ 1110.212554] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d with Priority: HIGHEST for action security_group_members [ 1110.212814] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c718081-e5df-4901-a082-56a5b8ccbf2d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.212938] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.213021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.213220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.213405] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.213540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.213623] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.214373] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.214373] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.214373] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.716734] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.716930] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.717028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.717325] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.717444] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.717652] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.717753] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.717829] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.718029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.718126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.718217] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d is going to be updated. [ 1110.748666] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.748839] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.748926] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.749183] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.749374] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.759845] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d in Status: IN_PROGRESS for 2s [ 1112.558220] env[66994]: INFO networking_nsxv3.common.synchronization [req-7870ff25-b332-424f-b763-7f9fe4aefcdd req-8ef8b12e-d8aa-46b0-b74c-bb054f9a349b tempest-AttachVolumeNegativeTest-1341698298 tempest-AttachVolumeNegativeTest-1341698298-project-member] Enqueued Resource ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 with Priority: HIGHEST for action security_group_members [ 1112.558867] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 with Priority: HIGHEST for action security_group_members [ 1112.559224] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.559353] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.559420] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.559892] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.559892] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.560074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.560074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.560168] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.560218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.560351] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.771902] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d in Status: SUCCESS [ 1112.772228] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d deletion is rescheduled due to dependency. [ 1112.772457] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.916270] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-532 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.916489] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-532" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.916640] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-532" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.918018] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-532" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.918018] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.918018] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.918018] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.918018] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.918018] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.918350] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1112.918350] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1112.918439] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1112.918561] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1112.918691] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1112.918795] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1112.918924] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1112.941391] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1112.941562] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1112.941749] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1112.941960] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-532" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.942359] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-97da629e-f9fa-4d0b-b96c-9d003a6563c2 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.942613] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-97da629e-f9fa-4d0b-b96c-9d003a6563c2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.942768] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-97da629e-f9fa-4d0b-b96c-9d003a6563c2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.943308] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-97da629e-f9fa-4d0b-b96c-9d003a6563c2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.943427] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97da629e-f9fa-4d0b-b96c-9d003a6563c2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.062798] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.062993] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.063048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.063283] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.063380] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.063589] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.063687] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.063748] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.063898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.063971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.064067] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 already deleted. [ 1113.064149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.446810] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.447146] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.447406] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.447778] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.447941] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.448122] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 97da629e-f9fa-4d0b-b96c-9d003a6563c2 not found, creating... [ 1113.448421] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.448592] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.448710] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.448960] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.449112] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.449425] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.449575] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.449694] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.449907] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.450051] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.450193] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 97da629e-f9fa-4d0b-b96c-9d003a6563c2 is going to be created. [ 1113.479957] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.480246] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.480407] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.480736] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.481039] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.481316] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-97da629e-f9fa-4d0b-b96c-9d003a6563c2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.181344] env[66994]: INFO networking_nsxv3.common.synchronization [req-7870ff25-b332-424f-b763-7f9fe4aefcdd req-31bcb4e0-0bc5-426a-9371-1f343af6878e service nova] Enqueued Resource ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 with Priority: HIGHEST for action security_group_rules [ 1114.181628] env[66994]: INFO networking_nsxv3.common.synchronization [req-7870ff25-b332-424f-b763-7f9fe4aefcdd req-31bcb4e0-0bc5-426a-9371-1f343af6878e service nova] Enqueued Resource ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 with Priority: HIGHEST for action security_group_members [ 1114.181772] env[66994]: INFO networking_nsxv3.common.synchronization [req-7870ff25-b332-424f-b763-7f9fe4aefcdd req-31bcb4e0-0bc5-426a-9371-1f343af6878e service nova] Enqueued Resource ID: 97da629e-f9fa-4d0b-b96c-9d003a6563c2 with Priority: HIGHEST for action port [ 1114.183134] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 with Priority: HIGHEST for action security_group_rules [ 1114.183253] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 with Priority: HIGHEST for action security_group_members [ 1114.183352] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97da629e-f9fa-4d0b-b96c-9d003a6563c2 with Priority: HIGHEST for action port [ 1114.183636] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.183778] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.183908] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.184205] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.184316] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.185190] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.185313] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.185408] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.185587] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.185760] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.185866] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.185932] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.186103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.186189] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.186287] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.187059] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-97da629e-f9fa-4d0b-b96c-9d003a6563c2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.187182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97da629e-f9fa-4d0b-b96c-9d003a6563c2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.187248] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97da629e-f9fa-4d0b-b96c-9d003a6563c2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.187441] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97da629e-f9fa-4d0b-b96c-9d003a6563c2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.187516] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97da629e-f9fa-4d0b-b96c-9d003a6563c2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.689032] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.690191] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.690339] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.690652] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97da629e-f9fa-4d0b-b96c-9d003a6563c2 with status ACTIVE [ 1114.691602] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.691602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.691602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.691602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.691602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.691602] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.691602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.691602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.691976] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.692034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.692238] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.692348] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.692409] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.692578] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.693371] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.693371] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97da629e-f9fa-4d0b-b96c-9d003a6563c2 is going to be updated. [ 1114.714184] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.714356] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.714409] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.714737] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.714891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.715068] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97da629e-f9fa-4d0b-b96c-9d003a6563c2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.768769] env[66994]: INFO networking_nsxv3.common.synchronization [req-75a31c75-3162-4a00-96f4-86a491086f9b req-978b59a8-0b9f-4935-866e-1237af0042ce tempest-AttachInterfacesTestJSON-1437683655 tempest-AttachInterfacesTestJSON-1437683655-project-member] Enqueued Resource ID: 661b2c26-8339-44c8-bda6-1d75548802e0 with Priority: HIGHEST for action security_group_members [ 1114.768850] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 661b2c26-8339-44c8-bda6-1d75548802e0 with Priority: HIGHEST for action security_group_members [ 1114.769177] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-661b2c26-8339-44c8-bda6-1d75548802e0 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.769301] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.769429] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.769628] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.769758] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.769857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.769918] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.770075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.770158] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.770250] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('661b2c26-8339-44c8-bda6-1d75548802e0',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.068597] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.068797] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.068919] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.069218] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.069474] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.069630] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.069746] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.069991] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.070356] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.070580] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1115.070714] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1115.070799] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1115.070905] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1115.071020] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1115.071128] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1115.071261] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1115.090333] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1115.090547] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1115.090619] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1115.090776] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.091105] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-6b08f6e7-aeb7-4af8-9781-7d1ee1bfa459 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.091277] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-6b08f6e7-aeb7-4af8-9781-7d1ee1bfa459" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.091396] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-6b08f6e7-aeb7-4af8-9781-7d1ee1bfa459" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.091726] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-6b08f6e7-aeb7-4af8-9781-7d1ee1bfa459" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.091861] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b08f6e7-aeb7-4af8-9781-7d1ee1bfa459',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.190949] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.272557] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.272741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.272848] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.273103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.273202] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.273407] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.273514] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.273580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.273891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.273891] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.273891] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 661b2c26-8339-44c8-bda6-1d75548802e0 already deleted. [ 1115.274057] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.594275] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.594568] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.594749] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.595097] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.595276] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.595487] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 6b08f6e7-aeb7-4af8-9781-7d1ee1bfa459 not found, creating... [ 1115.595813] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.596048] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.596240] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.596589] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.596815] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.597257] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.597587] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.597786] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.598292] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.598292] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.598511] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 6b08f6e7-aeb7-4af8-9781-7d1ee1bfa459 is going to be created. [ 1115.623997] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.624350] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.624506] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.624821] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.625066] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.625389] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-6b08f6e7-aeb7-4af8-9781-7d1ee1bfa459" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.693647] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.693849] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.693898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.694172] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.694274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.694391] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 is going to be created. [ 1115.723846] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.724080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.724080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.724345] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.724528] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.736501] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 in Status: UNINITIALIZED for 2s [ 1116.372421] env[66994]: INFO networking_nsxv3.common.synchronization [req-75a31c75-3162-4a00-96f4-86a491086f9b req-865704e7-a6f5-4215-8339-c366b8336276 service nova] Enqueued Resource ID: 661b2c26-8339-44c8-bda6-1d75548802e0 with Priority: HIGHEST for action security_group_rules [ 1116.372674] env[66994]: INFO networking_nsxv3.common.synchronization [req-75a31c75-3162-4a00-96f4-86a491086f9b req-865704e7-a6f5-4215-8339-c366b8336276 service nova] Enqueued Resource ID: 661b2c26-8339-44c8-bda6-1d75548802e0 with Priority: HIGHEST for action security_group_members [ 1116.372773] env[66994]: INFO networking_nsxv3.common.synchronization [req-75a31c75-3162-4a00-96f4-86a491086f9b req-865704e7-a6f5-4215-8339-c366b8336276 service nova] Enqueued Resource ID: 6b08f6e7-aeb7-4af8-9781-7d1ee1bfa459 with Priority: HIGHEST for action port [ 1116.373318] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 661b2c26-8339-44c8-bda6-1d75548802e0 with Priority: HIGHEST for action security_group_rules [ 1116.373454] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 661b2c26-8339-44c8-bda6-1d75548802e0 with Priority: HIGHEST for action security_group_members [ 1116.373551] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b08f6e7-aeb7-4af8-9781-7d1ee1bfa459 with Priority: HIGHEST for action port [ 1116.374015] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-661b2c26-8339-44c8-bda6-1d75548802e0 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.374142] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.374210] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.374409] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.374496] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('661b2c26-8339-44c8-bda6-1d75548802e0',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.377319] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-661b2c26-8339-44c8-bda6-1d75548802e0 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.377476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.377547] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.377762] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.377913] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.378022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.378086] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.378355] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.378436] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.379025] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('661b2c26-8339-44c8-bda6-1d75548802e0',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.380282] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b08f6e7-aeb7-4af8-9781-7d1ee1bfa459 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.380448] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b08f6e7-aeb7-4af8-9781-7d1ee1bfa459" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.380556] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b08f6e7-aeb7-4af8-9781-7d1ee1bfa459" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.380797] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b08f6e7-aeb7-4af8-9781-7d1ee1bfa459" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.380916] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b08f6e7-aeb7-4af8-9781-7d1ee1bfa459',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.881115] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('661b2c26-8339-44c8-bda6-1d75548802e0',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.884014] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-661b2c26-8339-44c8-bda6-1d75548802e0 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.884014] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.884014] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b08f6e7-aeb7-4af8-9781-7d1ee1bfa459 with status ACTIVE [ 1116.884014] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.884014] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.884014] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.884014] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.884014] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.884014] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.884014] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.884423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.886187] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.886323] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.886530] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.886641] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.886693] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.886852] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.886984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.887042] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b08f6e7-aeb7-4af8-9781-7d1ee1bfa459 is going to be updated. [ 1116.910615] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.910766] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.910835] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.911074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.911222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.911388] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b08f6e7-aeb7-4af8-9781-7d1ee1bfa459" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.384396] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('661b2c26-8339-44c8-bda6-1d75548802e0',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.747769] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 in Status: SUCCESS [ 1117.748010] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.748210] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.748440] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.748648] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.748766] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.748830] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.749038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.749142] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.749232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.749320] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.887160] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.887277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.887349] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.887654] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.887760] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.887867] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 661b2c26-8339-44c8-bda6-1d75548802e0 is going to be created. [ 1117.915511] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.915705] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.915754] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.915964] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.916169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.926706] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 661b2c26-8339-44c8-bda6-1d75548802e0 in Status: UNINITIALIZED for 2s [ 1118.251244] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.753904] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21: rpc.has_security_group_logging(os_id): False [ 1118.773592] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.773743] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.773811] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.774044] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.774139] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.774389] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.774598] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.774598] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.774695] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.774772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.774905] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 is going to be created. [ 1118.846136] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.846136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.846136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.846136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.846136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.859287] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 in Status: IN_PROGRESS for 2s [ 1119.937051] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 661b2c26-8339-44c8-bda6-1d75548802e0 in Status: SUCCESS [ 1119.937340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.937597] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.937828] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.938056] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.938184] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.938252] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.938443] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.938583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.938583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.938670] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('661b2c26-8339-44c8-bda6-1d75548802e0',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.441676] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('661b2c26-8339-44c8-bda6-1d75548802e0',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.872937] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 in Status: SUCCESS [ 1120.872937] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.944801] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 661b2c26-8339-44c8-bda6-1d75548802e0: rpc.has_security_group_logging(os_id): False [ 1120.976320] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.976607] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.976769] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.977159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.977329] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.977752] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.977910] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.978064] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.978340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.978508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.978658] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 661b2c26-8339-44c8-bda6-1d75548802e0 is going to be created. [ 1121.056115] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.056308] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.057044] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.057044] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.057044] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.071035] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 661b2c26-8339-44c8-bda6-1d75548802e0 in Status: IN_PROGRESS for 2s [ 1121.375126] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1121.375257] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1123.090280] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 661b2c26-8339-44c8-bda6-1d75548802e0 in Status: SUCCESS [ 1123.090540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.570215] env[66994]: INFO networking_nsxv3.common.synchronization [req-2829d4ce-fb1b-4fd4-bcb1-92971377245b req-7046cb0b-4dbd-4cf2-b958-ac4525522e9f tempest-DeleteServersTestJSON-15988793 tempest-DeleteServersTestJSON-15988793-project-member] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1123.570863] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1123.571561] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.571714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.571794] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.572011] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.572202] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.572326] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.572392] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.572530] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.572596] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.573201] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.075553] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.075728] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.075790] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.076029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.076125] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.076337] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.076440] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.076494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.076669] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.076754] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.076853] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be updated. [ 1124.080021] env[66994]: INFO networking_nsxv3.common.synchronization [req-912aa61d-a387-4c34-b562-b952e09a8755 req-8ea9a6cc-0903-455a-a1cd-ea3b6f3e2d6e tempest-ServerActionsTestOtherB-1891732265 tempest-ServerActionsTestOtherB-1891732265-project-member] Enqueued Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_members [ 1124.080972] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_members [ 1124.081631] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.081744] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.081813] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.081982] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.082142] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.082237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.082301] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.082443] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.082525] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.082615] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.111532] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.111532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.111532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.112036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.112036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.122419] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: IN_PROGRESS for 2s [ 1124.584494] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.584661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.584726] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.584981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.585114] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.585311] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.585469] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.585511] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.585683] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.585753] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.585844] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e is going to be updated. [ 1124.615370] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.615589] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.615665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.615847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.615988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.628106] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: IN_PROGRESS for 2s [ 1126.133322] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: SUCCESS [ 1126.133713] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 deletion is rescheduled due to dependency. [ 1126.133713] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.639251] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: SUCCESS [ 1126.639446] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e deletion is rescheduled due to dependency. [ 1126.639579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.082338] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1129.082716] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1131.884132] env[66994]: INFO networking_nsxv3.common.synchronization [req-7b325ef7-ecbb-47f2-a018-163f53b70626 req-0697fac7-e252-4365-8a9b-91697011caac tempest-DeleteServersTestJSON-15988793 tempest-DeleteServersTestJSON-15988793-project-member] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1131.884717] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1131.885171] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.885324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.885394] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.885652] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.886222] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.886334] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.886398] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.886554] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.886642] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.886761] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.204807] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-160 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.205109] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.205268] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.205639] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.205944] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.206120] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.206239] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.206470] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.206640] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.206943] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1132.207161] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1132.207286] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1132.207397] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1132.207510] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1132.207670] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1132.207814] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1132.232281] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1132.232475] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1132.232633] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1132.232800] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.233175] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-79288a07-00ea-4450-900d-83cf29713fd0 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.233345] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-79288a07-00ea-4450-900d-83cf29713fd0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.233493] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-79288a07-00ea-4450-900d-83cf29713fd0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.233853] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-79288a07-00ea-4450-900d-83cf29713fd0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.233988] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79288a07-00ea-4450-900d-83cf29713fd0',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.389088] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.389372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.389372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.389629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.389761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.390045] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.390169] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.390244] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.390422] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.390534] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.390634] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be updated. [ 1132.427798] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.428046] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.428046] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.428270] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.428415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.440703] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: IN_PROGRESS for 2s [ 1132.736380] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.736594] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.736708] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.737052] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.737257] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.737423] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 79288a07-00ea-4450-900d-83cf29713fd0 not found, creating... [ 1132.737746] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.737910] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.738038] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.738268] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.738405] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.738706] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.738872] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.738991] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.739217] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.739353] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.739491] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 79288a07-00ea-4450-900d-83cf29713fd0 is going to be created. [ 1132.760111] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.760323] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.760447] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.760715] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.760946] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.761189] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-79288a07-00ea-4450-900d-83cf29713fd0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.460527] env[66994]: INFO networking_nsxv3.common.synchronization [req-7b325ef7-ecbb-47f2-a018-163f53b70626 req-7f672c05-31fa-4582-9672-874926a02aac service nova] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_rules [ 1133.460817] env[66994]: INFO networking_nsxv3.common.synchronization [req-7b325ef7-ecbb-47f2-a018-163f53b70626 req-7f672c05-31fa-4582-9672-874926a02aac service nova] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1133.460817] env[66994]: INFO networking_nsxv3.common.synchronization [req-7b325ef7-ecbb-47f2-a018-163f53b70626 req-7f672c05-31fa-4582-9672-874926a02aac service nova] Enqueued Resource ID: 79288a07-00ea-4450-900d-83cf29713fd0 with Priority: HIGHEST for action port [ 1133.461350] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_rules [ 1133.461549] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1133.461649] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79288a07-00ea-4450-900d-83cf29713fd0 with Priority: HIGHEST for action port [ 1133.461912] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.461993] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.462098] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.462323] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.462400] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.463333] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.463333] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.463693] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-79288a07-00ea-4450-900d-83cf29713fd0 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.463812] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79288a07-00ea-4450-900d-83cf29713fd0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.463877] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79288a07-00ea-4450-900d-83cf29713fd0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.464052] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79288a07-00ea-4450-900d-83cf29713fd0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.464128] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79288a07-00ea-4450-900d-83cf29713fd0',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.965839] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.966044] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.966280] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79288a07-00ea-4450-900d-83cf29713fd0 with status ACTIVE [ 1133.966484] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.966630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.966716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.966939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.967067] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.967265] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.967361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.967417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.967571] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.967658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.967941] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.967997] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.968042] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.968188] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.968261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.968344] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79288a07-00ea-4450-900d-83cf29713fd0 is going to be updated. [ 1133.990552] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.990789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.990789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.991020] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.991171] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.991329] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79288a07-00ea-4450-900d-83cf29713fd0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.450764] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: SUCCESS [ 1134.450968] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 deletion is rescheduled due to dependency. [ 1134.451090] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.451277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.451504] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.451681] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.451805] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.451879] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.452010] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.452081] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.452181] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.954005] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.100961] env[66994]: INFO networking_nsxv3.common.synchronization [req-231e5295-7079-41e7-ba92-604027076b7f req-331c3719-80ba-499f-bf50-ac010f96d582 tempest-ServerActionsTestOtherB-1891732265 tempest-ServerActionsTestOtherB-1891732265-project-member] Enqueued Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_members [ 1135.101345] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_members [ 1135.102034] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.102034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.102034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.102034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.102293] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.102402] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.102509] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.102629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.102714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.102805] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.370028] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-729 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.370028] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-729" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.370028] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-729" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.370325] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-729" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.370627] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.370813] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.370952] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.371379] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.371591] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.371836] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.371974] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1135.372126] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1135.372253] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1135.372386] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.372511] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1135.372663] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1135.392315] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1135.392490] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1135.392640] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1135.392863] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-729" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.393200] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-738aff9c-8c13-48f3-aa10-507f02af90ac taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.393371] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-738aff9c-8c13-48f3-aa10-507f02af90ac" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.393528] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-738aff9c-8c13-48f3-aa10-507f02af90ac" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.393957] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-738aff9c-8c13-48f3-aa10-507f02af90ac" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.394194] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('738aff9c-8c13-48f3-aa10-507f02af90ac',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.456373] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.604854] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.605073] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.605137] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.605391] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.605501] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.605726] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.605834] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.605895] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.606077] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.606158] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.606250] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e is going to be updated. [ 1135.633064] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.633258] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.633258] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.633422] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.633611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.648560] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: IN_PROGRESS for 2s [ 1135.899173] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.899413] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.899529] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.899877] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.900013] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.900174] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 738aff9c-8c13-48f3-aa10-507f02af90ac not found, creating... [ 1135.900432] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.900588] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.900703] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.900924] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.901070] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.901392] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.901550] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.901661] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.901861] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.901988] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.902146] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 738aff9c-8c13-48f3-aa10-507f02af90ac is going to be created. [ 1135.924528] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.924739] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.924880] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.925250] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.925392] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.925630] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-738aff9c-8c13-48f3-aa10-507f02af90ac" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.960035] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.960035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.960035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.960462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.960462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.960462] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be updated. [ 1135.992893] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.993153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.993267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.993947] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.993947] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.006133] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: IN_PROGRESS for 2s [ 1136.712320] env[66994]: INFO networking_nsxv3.common.synchronization [req-231e5295-7079-41e7-ba92-604027076b7f req-9efc8fdc-adbd-41fc-8f36-de0c8cd6c0a1 service nova] Enqueued Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_rules [ 1136.712320] env[66994]: INFO networking_nsxv3.common.synchronization [req-231e5295-7079-41e7-ba92-604027076b7f req-9efc8fdc-adbd-41fc-8f36-de0c8cd6c0a1 service nova] Enqueued Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_members [ 1136.712320] env[66994]: INFO networking_nsxv3.common.synchronization [req-231e5295-7079-41e7-ba92-604027076b7f req-9efc8fdc-adbd-41fc-8f36-de0c8cd6c0a1 service nova] Enqueued Resource ID: 738aff9c-8c13-48f3-aa10-507f02af90ac with Priority: HIGHEST for action port [ 1136.712792] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_rules [ 1136.713041] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_members [ 1136.713277] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738aff9c-8c13-48f3-aa10-507f02af90ac with Priority: HIGHEST for action port [ 1136.713719] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.714141] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.714740] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.714740] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.714740] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.716686] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.717154] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.717916] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-738aff9c-8c13-48f3-aa10-507f02af90ac taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.718787] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-738aff9c-8c13-48f3-aa10-507f02af90ac" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.718787] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-738aff9c-8c13-48f3-aa10-507f02af90ac" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.718787] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-738aff9c-8c13-48f3-aa10-507f02af90ac" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.718787] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('738aff9c-8c13-48f3-aa10-507f02af90ac',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.217749] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.218136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.220322] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 738aff9c-8c13-48f3-aa10-507f02af90ac with status ACTIVE [ 1137.220509] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.220638] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.220708] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.220917] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.221015] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.221553] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.221553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.221553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.221553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.221722] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.222092] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.222092] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.222092] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.222515] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.222515] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.222598] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 738aff9c-8c13-48f3-aa10-507f02af90ac is going to be updated. [ 1137.246599] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.246826] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.246913] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.247144] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.247334] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.247466] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-738aff9c-8c13-48f3-aa10-507f02af90ac" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.661274] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: SUCCESS [ 1137.661477] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e deletion is rescheduled due to dependency. [ 1137.661554] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.661752] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.661984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.662192] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.662311] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.662376] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.662535] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.662615] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.662726] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.018301] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: SUCCESS [ 1138.018482] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.018693] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.018964] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.019177] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.019297] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.019361] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.019514] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.019593] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.019678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.019765] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.165286] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.522524] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.522970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.522970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.522970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.523166] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.523274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.523338] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.523497] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.523587] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.523671] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.523914] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.524015] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.524066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.524209] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.524350] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.524447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.524522] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.524661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.524738] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.524815] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.524902] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.667623] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.026833] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0030483-0783-4db3-971a-f3155da229b7: rpc.has_security_group_logging(os_id): False [ 1139.045211] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.045426] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.045473] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.045704] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.045835] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.046084] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.046229] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.046339] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.046565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.046677] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.046929] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.047041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.047140] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.047288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.047386] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.047654] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.047833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.047895] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.048067] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.048176] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.048298] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be updated. [ 1139.112801] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.112965] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.113041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.113248] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.113411] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.134705] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: IN_PROGRESS for 2s [ 1139.169793] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.170129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.170266] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.170628] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.170811] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.170993] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e is going to be updated. [ 1139.230988] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.231197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.231245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.231466] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.231609] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.240715] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: IN_PROGRESS for 2s [ 1141.152954] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: SUCCESS [ 1141.152954] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.251738] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: SUCCESS [ 1141.251967] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.252178] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.252411] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.252609] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.252727] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.252793] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.252945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.253034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.253118] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.253208] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.714698] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1141.714823] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1141.755379] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.258510] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24a08da7-cf3b-41d4-b7f4-8e3b7616589e: rpc.has_security_group_logging(os_id): False [ 1142.278664] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.278893] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.278944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.279173] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.279292] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.279554] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.279656] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.279721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.279881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.279955] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.280055] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e is going to be updated. [ 1142.355306] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.355477] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.355559] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.355884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.356071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.380803] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: IN_PROGRESS for 2s [ 1144.395490] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: SUCCESS [ 1144.395724] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.386920] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.386920] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-988" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.387340] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-988" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.387340] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-988" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.387599] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.387729] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.387887] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.388226] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.388399] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.388635] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1146.388782] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1146.388888] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1146.389075] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1146.389140] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1146.389233] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1146.389362] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1146.408903] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1146.409130] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1146.409288] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1146.409412] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-988" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.409704] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-0a9176fd-1d2c-4b37-905d-594f595e4b4a taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.409975] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-0a9176fd-1d2c-4b37-905d-594f595e4b4a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.410152] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-0a9176fd-1d2c-4b37-905d-594f595e4b4a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.410406] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-0a9176fd-1d2c-4b37-905d-594f595e4b4a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.410539] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a9176fd-1d2c-4b37-905d-594f595e4b4a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.716575] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1146.716575] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1146.912699] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.912925] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.913085] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.913325] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.913468] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.913744] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.913897] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.914019] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.914227] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.914358] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.914625] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.914786] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.914901] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.915114] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.915246] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.915382] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 0a9176fd-1d2c-4b37-905d-594f595e4b4a is going to be updated. [ 1146.937897] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.938173] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.938291] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.938500] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.938694] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.939331] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-0a9176fd-1d2c-4b37-905d-594f595e4b4a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.181650] env[66994]: INFO networking_nsxv3.common.synchronization [req-8e10fe58-9807-401d-b406-16a3260253ae req-eb2f9f22-e345-497f-89f1-c8c3b74bcee4 tempest-DeleteServersTestJSON-15988793 tempest-DeleteServersTestJSON-15988793-project-member] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1147.182367] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1147.182735] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.182910] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.183016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.183439] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.183647] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.183985] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.183985] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.184114] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.184224] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.184328] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.646221] env[66994]: INFO networking_nsxv3.common.synchronization [req-50132089-b7d0-4b9e-bac4-79f954189015 req-44a7277f-96ac-44f7-a401-eb8b127a1782 service nova] Enqueued Resource ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 with Priority: HIGHEST for action security_group_rules [ 1147.646221] env[66994]: INFO networking_nsxv3.common.synchronization [req-50132089-b7d0-4b9e-bac4-79f954189015 req-44a7277f-96ac-44f7-a401-eb8b127a1782 service nova] Enqueued Resource ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 with Priority: HIGHEST for action security_group_members [ 1147.646221] env[66994]: INFO networking_nsxv3.common.synchronization [req-50132089-b7d0-4b9e-bac4-79f954189015 req-44a7277f-96ac-44f7-a401-eb8b127a1782 service nova] Enqueued Resource ID: 0a9176fd-1d2c-4b37-905d-594f595e4b4a with Priority: HIGHEST for action port [ 1147.646221] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 with Priority: HIGHEST for action security_group_rules [ 1147.646221] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 with Priority: HIGHEST for action security_group_members [ 1147.646221] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a9176fd-1d2c-4b37-905d-594f595e4b4a with Priority: HIGHEST for action port [ 1147.646997] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.647133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.647199] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.647407] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.647505] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.648378] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.648495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.648546] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.649167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.649167] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.649167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.649167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.649358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.649358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.649358] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.650732] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a9176fd-1d2c-4b37-905d-594f595e4b4a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.650848] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a9176fd-1d2c-4b37-905d-594f595e4b4a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.651074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a9176fd-1d2c-4b37-905d-594f595e4b4a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.651247] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a9176fd-1d2c-4b37-905d-594f595e4b4a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.652085] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a9176fd-1d2c-4b37-905d-594f595e4b4a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.686201] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.686371] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.686444] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.686646] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.686754] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.686954] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.687061] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.687120] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.687274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.687350] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.687439] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be updated. [ 1147.720036] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.720207] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.720280] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.720505] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.720650] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.732329] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: IN_PROGRESS for 2s [ 1148.153677] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a9176fd-1d2c-4b37-905d-594f595e4b4a with status ACTIVE [ 1148.154043] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.154196] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.154265] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.154552] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.154684] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.154900] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.155061] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.155152] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.155362] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.155464] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.155679] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.155831] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.155913] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.156101] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.156208] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.156314] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a9176fd-1d2c-4b37-905d-594f595e4b4a is going to be updated. [ 1148.157493] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.157993] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.158249] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.181021] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.181323] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.181482] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.181777] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.182035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.182256] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a9176fd-1d2c-4b37-905d-594f595e4b4a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.660512] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.163052] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.163237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.163237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.163421] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.163512] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.163614] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 is going to be updated. [ 1149.193767] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.193869] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.193979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.194178] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.194334] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.203628] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 in Status: IN_PROGRESS for 2s [ 1149.742732] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: SUCCESS [ 1149.743128] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 deletion is rescheduled due to dependency. [ 1149.743128] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.214271] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 in Status: SUCCESS [ 1151.214505] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.214555] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.214763] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.214958] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.215087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.215197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.215714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.215828] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.215953] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.216070] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.718739] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.221837] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9: rpc.has_security_group_logging(os_id): False [ 1152.267892] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.268156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.268156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.268342] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.268432] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.268690] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.268796] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.268854] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.269013] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.269119] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.269193] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 is going to be updated. [ 1152.349604] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.349604] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.349604] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.349604] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.349604] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.368598] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 in Status: IN_PROGRESS for 2s [ 1152.646374] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1152.646508] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1154.388350] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 in Status: SUCCESS [ 1154.388719] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.690107] env[66994]: INFO networking_nsxv3.common.synchronization [req-fe8320e1-dc88-4ee6-8aac-58593ac5a641 req-639c5811-c370-4fe5-b7dd-89fa75f6fee6 tempest-DeleteServersTestJSON-15988793 tempest-DeleteServersTestJSON-15988793-project-member] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1156.690471] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1156.690759] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.690879] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.690984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.691205] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.691367] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.691482] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.691537] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.691730] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.692028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.692168] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.991420] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-160 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.991655] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.991823] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.992219] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.992501] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.992720] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.992848] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.993191] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.993390] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.993639] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1156.993787] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1156.993927] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1156.994064] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1156.994210] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1156.994386] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1156.994607] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1157.017454] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1157.017754] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1157.018068] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1157.018357] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.018824] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-f38fb796-b561-49d0-87b5-ac861f93fab7 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.019072] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-f38fb796-b561-49d0-87b5-ac861f93fab7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.019252] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-f38fb796-b561-49d0-87b5-ac861f93fab7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.019675] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-f38fb796-b561-49d0-87b5-ac861f93fab7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.019879] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f38fb796-b561-49d0-87b5-ac861f93fab7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.194025] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.194228] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.194269] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.194561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.194668] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.194904] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.195055] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.195128] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.195308] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.195406] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.195518] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be updated. [ 1157.226284] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.226495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.226537] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.226740] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.226889] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.239201] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: IN_PROGRESS for 2s [ 1157.522719] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.523134] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.523381] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.523977] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.524250] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.524598] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port f38fb796-b561-49d0-87b5-ac861f93fab7 not found, creating... [ 1157.525074] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.525355] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.525554] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.525967] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.526237] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.526747] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.527046] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.527258] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.527645] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.527876] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.528171] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: f38fb796-b561-49d0-87b5-ac861f93fab7 is going to be created. [ 1157.556236] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.556592] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.556797] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.557243] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.557607] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.557963] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-f38fb796-b561-49d0-87b5-ac861f93fab7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.260709] env[66994]: INFO networking_nsxv3.common.synchronization [req-fe8320e1-dc88-4ee6-8aac-58593ac5a641 req-1ae90211-c875-4f25-9c74-bc20242c73f7 service nova] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_rules [ 1158.260949] env[66994]: INFO networking_nsxv3.common.synchronization [req-fe8320e1-dc88-4ee6-8aac-58593ac5a641 req-1ae90211-c875-4f25-9c74-bc20242c73f7 service nova] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1158.261084] env[66994]: INFO networking_nsxv3.common.synchronization [req-fe8320e1-dc88-4ee6-8aac-58593ac5a641 req-1ae90211-c875-4f25-9c74-bc20242c73f7 service nova] Enqueued Resource ID: f38fb796-b561-49d0-87b5-ac861f93fab7 with Priority: HIGHEST for action port [ 1158.261680] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_rules [ 1158.261813] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1158.261910] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f38fb796-b561-49d0-87b5-ac861f93fab7 with Priority: HIGHEST for action port [ 1158.262199] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.262328] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.262386] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.262584] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.262670] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.263630] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.263732] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.265718] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-f38fb796-b561-49d0-87b5-ac861f93fab7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.265718] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f38fb796-b561-49d0-87b5-ac861f93fab7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.265718] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f38fb796-b561-49d0-87b5-ac861f93fab7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.265718] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f38fb796-b561-49d0-87b5-ac861f93fab7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.265718] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f38fb796-b561-49d0-87b5-ac861f93fab7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.766350] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.766555] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.766634] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f38fb796-b561-49d0-87b5-ac861f93fab7 with status ACTIVE [ 1158.766802] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.766909] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.766974] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.768078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.768078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.768078] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.768078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.768078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.768078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.768078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.768078] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.768609] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.768609] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.768609] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.768609] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.768609] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f38fb796-b561-49d0-87b5-ac861f93fab7 is going to be updated. [ 1158.792779] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.792983] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.792983] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.793216] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.793352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.793518] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f38fb796-b561-49d0-87b5-ac861f93fab7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.252663] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: SUCCESS [ 1159.252860] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 deletion is rescheduled due to dependency. [ 1159.252932] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.253126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.253383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.253573] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.253692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.253757] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.253914] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.253997] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.254108] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.756443] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.258738] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.762227] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.762662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.762662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.762926] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.763028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.763326] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be updated. [ 1160.794178] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.794332] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.794397] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.794714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.794750] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.803614] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: IN_PROGRESS for 2s [ 1162.815687] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: SUCCESS [ 1162.816115] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.816219] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.816457] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.816652] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.816795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.816859] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.817036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.817121] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.817206] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.817314] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.263116] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1163.263248] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1163.319981] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.320206] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.320206] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.320472] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.320641] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.320745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.320803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.320959] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.321058] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.321147] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.321297] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.321392] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.321453] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.321597] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.321726] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.321814] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.321871] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.322019] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.322089] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.322171] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.322255] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.825923] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0030483-0783-4db3-971a-f3155da229b7: rpc.has_security_group_logging(os_id): False [ 1163.850494] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.850727] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.850727] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.851267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.851267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.851267] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.851468] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.851468] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.851548] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.851626] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.851834] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.851929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.851989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.852142] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.852213] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.852426] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.852519] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.852579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.852715] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.852787] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.852883] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be updated. [ 1163.918613] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.918805] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.918805] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.919013] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.919164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.937917] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: IN_PROGRESS for 2s [ 1165.960758] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: SUCCESS [ 1165.961326] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.005379] env[66994]: INFO networking_nsxv3.common.synchronization [req-91d157ab-3151-4358-a79d-b048cc91ea96 req-a646d4aa-6595-4887-a1bd-de708cc68213 tempest-AttachInterfacesTestJSON-1437683655 tempest-AttachInterfacesTestJSON-1437683655-project-member] Enqueued Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1168.006038] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1168.006245] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.006392] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.006721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.006721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.006800] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.006886] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.006981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.007204] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.007274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.007372] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.297279] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.297526] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.297639] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.297914] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.298250] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.298408] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.298522] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.298731] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.298873] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.299090] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1168.299204] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1168.299313] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1168.299419] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1168.299525] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1168.299629] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1168.299760] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1168.320477] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1168.320657] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1168.320763] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1168.320929] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.321253] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-8988b3f0-b938-4b8b-973b-ae1c43a9fe6e taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.321427] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-8988b3f0-b938-4b8b-973b-ae1c43a9fe6e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.321546] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-8988b3f0-b938-4b8b-973b-ae1c43a9fe6e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.321896] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-8988b3f0-b938-4b8b-973b-ae1c43a9fe6e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.322054] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8988b3f0-b938-4b8b-973b-ae1c43a9fe6e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.510578] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.510764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.510806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.511053] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.511163] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.511369] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.511473] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.511530] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.511690] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.511798] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.511903] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa is going to be updated. [ 1168.541896] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.542113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.542164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.542355] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.542504] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.553484] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: IN_PROGRESS for 2s [ 1168.824457] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.824693] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.824820] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.825158] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.825334] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.825502] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 8988b3f0-b938-4b8b-973b-ae1c43a9fe6e not found, creating... [ 1168.825788] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.826030] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.826182] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.826439] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.826578] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.826884] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.827426] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.827426] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.827426] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.827569] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.827666] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 8988b3f0-b938-4b8b-973b-ae1c43a9fe6e is going to be created. [ 1168.850848] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.850939] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.851059] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.851427] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.851693] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.851921] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-8988b3f0-b938-4b8b-973b-ae1c43a9fe6e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.556518] env[66994]: INFO networking_nsxv3.common.synchronization [req-91d157ab-3151-4358-a79d-b048cc91ea96 req-1d848f01-4874-49c9-9337-30988f07798b service nova] Enqueued Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_rules [ 1169.556764] env[66994]: INFO networking_nsxv3.common.synchronization [req-91d157ab-3151-4358-a79d-b048cc91ea96 req-1d848f01-4874-49c9-9337-30988f07798b service nova] Enqueued Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1169.556764] env[66994]: INFO networking_nsxv3.common.synchronization [req-91d157ab-3151-4358-a79d-b048cc91ea96 req-1d848f01-4874-49c9-9337-30988f07798b service nova] Enqueued Resource ID: 8988b3f0-b938-4b8b-973b-ae1c43a9fe6e with Priority: HIGHEST for action port [ 1169.557552] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_rules [ 1169.557552] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1169.557552] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8988b3f0-b938-4b8b-973b-ae1c43a9fe6e with Priority: HIGHEST for action port [ 1169.557852] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.557975] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.558303] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.558481] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.558761] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.560330] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.560435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.560630] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-8988b3f0-b938-4b8b-973b-ae1c43a9fe6e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.560734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8988b3f0-b938-4b8b-973b-ae1c43a9fe6e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.560930] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8988b3f0-b938-4b8b-973b-ae1c43a9fe6e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.560996] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8988b3f0-b938-4b8b-973b-ae1c43a9fe6e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.561054] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8988b3f0-b938-4b8b-973b-ae1c43a9fe6e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.061049] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.061049] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.062900] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8988b3f0-b938-4b8b-973b-ae1c43a9fe6e with status ACTIVE [ 1170.063118] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.063281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.063352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.063574] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.063673] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.063843] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.063978] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.064045] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.064225] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.064291] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.064474] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.064568] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.064630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.064771] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.064855] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.064975] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8988b3f0-b938-4b8b-973b-ae1c43a9fe6e is going to be updated. [ 1170.087564] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.087769] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.087859] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.088139] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.088269] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.088435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8988b3f0-b938-4b8b-973b-ae1c43a9fe6e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.564026] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: SUCCESS [ 1170.564967] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa deletion is rescheduled due to dependency. [ 1170.564967] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.564967] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.565253] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.565452] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.565569] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.565633] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.566622] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.566622] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.566622] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.808575] env[66994]: INFO networking_nsxv3.common.synchronization [req-82c8544a-a022-45dd-957f-bb2d0bb4e970 req-86b94005-9ef2-4a73-a09c-7ddc620a69aa tempest-DeleteServersTestJSON-15988793 tempest-DeleteServersTestJSON-15988793-project-member] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1170.809375] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1170.809581] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.809816] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.809816] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.810040] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.810231] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.810397] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.810499] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.810754] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.810828] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.810971] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.068248] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.313550] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.313711] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.313755] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.313954] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.314060] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.314328] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.314421] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.314461] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.314599] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.314719] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.314822] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be updated. [ 1171.346597] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.346776] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.346822] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.346995] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.347153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.355677] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: IN_PROGRESS for 2s [ 1171.571792] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.075274] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.075457] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.075595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.075729] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.075821] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.075923] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa is going to be updated. [ 1172.126439] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.126683] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.126683] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.126855] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.127141] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.135798] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: IN_PROGRESS for 2s [ 1173.366413] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: SUCCESS [ 1173.366798] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 deletion is rescheduled due to dependency. [ 1173.366798] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.146075] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: SUCCESS [ 1174.146324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.146479] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.146696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.146923] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.147059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.147127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.147292] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.147371] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.147454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.147542] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.553247] env[66994]: INFO networking_nsxv3.common.synchronization [None req-1cc31979-4780-47b1-b9de-614feb3d06b1 tempest-AttachInterfacesTestJSON-1437683655 tempest-AttachInterfacesTestJSON-1437683655-project-member] Enqueued Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1174.553783] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1174.554091] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.554213] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.554278] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.554479] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.554614] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.554706] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.554768] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.554908] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.554990] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.555091] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.650102] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.650963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.058250] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.560716] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.063398] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.063640] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.063796] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.064227] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.064456] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.064624] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa is going to be updated. [ 1176.096036] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.096276] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.096276] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.096478] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.096675] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.108511] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: IN_PROGRESS for 2s [ 1176.702814] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.703150] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.703150] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.703411] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.703665] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.703819] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.703932] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.704171] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.704316] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.704593] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1176.704709] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1176.704817] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1176.704923] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1176.705042] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1176.705150] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1176.705283] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1176.725985] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1176.726178] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1176.726331] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1176.726513] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.726829] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-805df6ae-3a13-4c41-9485-3dbddff36f11 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.727013] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-805df6ae-3a13-4c41-9485-3dbddff36f11" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.727133] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-805df6ae-3a13-4c41-9485-3dbddff36f11" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.727460] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-805df6ae-3a13-4c41-9485-3dbddff36f11" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.727600] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('805df6ae-3a13-4c41-9485-3dbddff36f11',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.230615] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.231240] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.231473] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.231834] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.232078] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.232320] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 805df6ae-3a13-4c41-9485-3dbddff36f11 not found, creating... [ 1177.232741] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.233031] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.233257] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.233720] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.233957] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.234333] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.234621] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.234830] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.235139] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.235345] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.235556] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 805df6ae-3a13-4c41-9485-3dbddff36f11 is going to be created. [ 1177.257407] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.257638] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.257733] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.257989] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.258293] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.258536] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-805df6ae-3a13-4c41-9485-3dbddff36f11" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.966125] env[66994]: INFO networking_nsxv3.common.synchronization [req-1d7e1076-24b7-43f1-89f2-3c800ac0a053 req-1f5fdd94-7b65-498f-b394-6d1b597cfbf4 service nova] Enqueued Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_rules [ 1177.966907] env[66994]: INFO networking_nsxv3.common.synchronization [req-1d7e1076-24b7-43f1-89f2-3c800ac0a053 req-1f5fdd94-7b65-498f-b394-6d1b597cfbf4 service nova] Enqueued Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1177.966907] env[66994]: INFO networking_nsxv3.common.synchronization [req-1d7e1076-24b7-43f1-89f2-3c800ac0a053 req-1f5fdd94-7b65-498f-b394-6d1b597cfbf4 service nova] Enqueued Resource ID: 805df6ae-3a13-4c41-9485-3dbddff36f11 with Priority: HIGHEST for action port [ 1177.967235] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_rules [ 1177.967407] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1177.967557] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 805df6ae-3a13-4c41-9485-3dbddff36f11 with Priority: HIGHEST for action port [ 1177.968582] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.968582] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.968582] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.968582] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.968582] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-805df6ae-3a13-4c41-9485-3dbddff36f11 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.968804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-805df6ae-3a13-4c41-9485-3dbddff36f11" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.968804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-805df6ae-3a13-4c41-9485-3dbddff36f11" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.969184] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-805df6ae-3a13-4c41-9485-3dbddff36f11" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.969184] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('805df6ae-3a13-4c41-9485-3dbddff36f11',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.119366] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: SUCCESS [ 1178.119594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.119754] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.119969] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.120181] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.120299] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.120364] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.120516] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.120595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.120678] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.120849] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.120929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.120989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.121137] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.121272] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.121364] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.121443] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.121638] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.121717] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.121799] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.121882] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.122902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.122902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.123045] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.123103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.123137] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.123282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.123357] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.123438] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.473127] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 805df6ae-3a13-4c41-9485-3dbddff36f11 with status ACTIVE [ 1178.473354] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.473506] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.473620] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.473852] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.473950] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.474171] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.474301] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.474420] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.474526] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.474734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.474828] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.474931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.474990] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.475167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.475274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.475334] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 805df6ae-3a13-4c41-9485-3dbddff36f11 is going to be updated. [ 1178.499892] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.500135] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.500135] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.500306] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.500441] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.500600] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-805df6ae-3a13-4c41-9485-3dbddff36f11" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.625277] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b740b91b-8f03-45e7-909b-66803d9ffafa: rpc.has_security_group_logging(os_id): False [ 1178.627913] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.651698] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.651913] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.651913] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.652196] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.652372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.652482] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.652584] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.652642] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.652784] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.652847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.653237] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.653237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.653237] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.653502] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.653502] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.653645] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.653734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.653787] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.653928] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.653997] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.654095] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa is going to be updated. [ 1178.742278] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.742489] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.742489] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.742646] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.742788] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.757699] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: IN_PROGRESS for 2s [ 1179.131368] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.241729] env[66994]: INFO networking_nsxv3.common.synchronization [req-c93f3d39-f5e7-4900-aee7-5eb9f5a8f5e3 req-506260d3-70b6-4300-8cc5-c59dbf1d3511 tempest-AttachVolumeNegativeTest-1341698298 tempest-AttachVolumeNegativeTest-1341698298-project-member] Enqueued Resource ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 with Priority: HIGHEST for action security_group_members [ 1179.242156] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 with Priority: HIGHEST for action security_group_members [ 1179.243964] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.243964] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.243964] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.243964] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.243964] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.243964] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.243964] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.243964] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.243964] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.243964] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.567915] env[66994]: INFO networking_nsxv3.common.synchronization [req-bb3e96db-b931-4ca0-90eb-bb04de8d7e4c req-dcc6c952-cafc-45a3-9c52-fe51d33b5433 tempest-DeleteServersTestJSON-15988793 tempest-DeleteServersTestJSON-15988793-project-member] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1179.568533] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1179.568871] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.568996] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.569329] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.569580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.569753] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.569859] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.569931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.570101] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.570198] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.570303] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.633957] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.633957] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.633957] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.633957] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.634244] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.634244] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa is going to be updated. [ 1179.663652] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.663773] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.663886] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.664065] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.664213] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.674072] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: IN_PROGRESS for 2s [ 1179.745983] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.746211] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.746256] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.746437] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.746552] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.746718] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.746818] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.746876] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.747037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.747114] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.747204] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 is going to be updated. [ 1179.774419] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.774419] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.774740] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.774740] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.774886] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.784840] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 in Status: IN_PROGRESS for 2s [ 1179.879178] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-160 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.879424] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.879551] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.879810] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.880073] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.880233] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.880345] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.880553] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.880703] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.880936] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1179.881073] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1179.881183] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1179.881289] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1179.881400] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1179.881502] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1179.881633] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1179.904324] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1179.904324] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1179.904456] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1179.905013] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-160" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.905013] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-e7db0401-6519-4cb9-9e19-a8d55462279e taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.905339] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-e7db0401-6519-4cb9-9e19-a8d55462279e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.905393] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-e7db0401-6519-4cb9-9e19-a8d55462279e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.905681] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-e7db0401-6519-4cb9-9e19-a8d55462279e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.905824] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7db0401-6519-4cb9-9e19-a8d55462279e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.075950] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.076255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.076255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.076454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.076551] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.076796] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.076884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.076923] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.077061] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.077138] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.077246] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be updated. [ 1180.111091] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.111326] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.111326] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.111514] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.111658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.123302] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: IN_PROGRESS for 2s [ 1180.410150] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.410508] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.410560] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.410851] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.411053] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.411250] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port e7db0401-6519-4cb9-9e19-a8d55462279e not found, creating... [ 1180.411551] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.411733] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.411858] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.412141] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.412291] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.412614] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.412793] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.412920] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.413533] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.413533] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.413533] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: e7db0401-6519-4cb9-9e19-a8d55462279e is going to be created. [ 1180.433834] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.434049] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.434196] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.434427] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.434645] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.434860] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-e7db0401-6519-4cb9-9e19-a8d55462279e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.772452] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: SUCCESS [ 1180.772806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.773064] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.773416] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.773562] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.127519] env[66994]: INFO networking_nsxv3.common.synchronization [req-bb3e96db-b931-4ca0-90eb-bb04de8d7e4c req-25ec3554-7c4d-4bce-bc25-1cee8e31276c service nova] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_rules [ 1181.127709] env[66994]: INFO networking_nsxv3.common.synchronization [req-bb3e96db-b931-4ca0-90eb-bb04de8d7e4c req-25ec3554-7c4d-4bce-bc25-1cee8e31276c service nova] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1181.127845] env[66994]: INFO networking_nsxv3.common.synchronization [req-bb3e96db-b931-4ca0-90eb-bb04de8d7e4c req-25ec3554-7c4d-4bce-bc25-1cee8e31276c service nova] Enqueued Resource ID: e7db0401-6519-4cb9-9e19-a8d55462279e with Priority: HIGHEST for action port [ 1181.128430] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_rules [ 1181.128559] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1181.128654] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7db0401-6519-4cb9-9e19-a8d55462279e with Priority: HIGHEST for action port [ 1181.128929] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.129059] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.129125] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.129347] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.129431] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.130275] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.130375] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.130935] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7db0401-6519-4cb9-9e19-a8d55462279e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.130935] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7db0401-6519-4cb9-9e19-a8d55462279e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.130935] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7db0401-6519-4cb9-9e19-a8d55462279e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.130935] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7db0401-6519-4cb9-9e19-a8d55462279e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.130935] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7db0401-6519-4cb9-9e19-a8d55462279e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.276033] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.276033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.632503] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.632905] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.632905] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e7db0401-6519-4cb9-9e19-a8d55462279e with status ACTIVE [ 1181.633090] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.633090] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.633190] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.633357] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.633450] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.633624] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.633748] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.633785] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.633920] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.633999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.634193] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.634335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.634335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.634474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.634544] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.634630] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e7db0401-6519-4cb9-9e19-a8d55462279e is going to be updated. [ 1181.655552] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.655821] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.655821] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.655984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.656103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.656252] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7db0401-6519-4cb9-9e19-a8d55462279e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.683520] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: SUCCESS [ 1181.683744] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.683885] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.684108] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.684295] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.684410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.684469] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.684627] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.684716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.684786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.684877] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.794350] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 in Status: SUCCESS [ 1181.794541] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 deletion is rescheduled due to dependency. [ 1181.794659] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.133662] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: SUCCESS [ 1182.133836] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 deletion is rescheduled due to dependency. [ 1182.133954] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.134136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.134369] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.134554] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.134671] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.134737] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.134977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.135112] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.135209] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.186860] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.187011] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.187079] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.187294] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.187456] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.187556] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.187618] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.187830] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.187928] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.188026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.188179] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.188289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.188351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.188492] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.188629] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.188717] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.188775] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.188967] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.188997] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.189070] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.189161] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.637415] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.692294] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b740b91b-8f03-45e7-909b-66803d9ffafa: rpc.has_security_group_logging(os_id): False [ 1182.710987] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.711205] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.711205] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.711452] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.711576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.711814] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.711925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.711988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.712167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.712246] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.712438] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.712533] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.712594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.712757] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.712864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.713083] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.713180] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.713241] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.713379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.713451] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.713534] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa is going to be updated. [ 1182.775785] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.776032] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.776032] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.776242] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.776386] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.790141] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: IN_PROGRESS for 2s [ 1183.140345] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.642839] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.643296] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.643296] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.643446] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.644166] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.644166] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be updated. [ 1183.689055] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.689262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.689316] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.689553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.689716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.698436] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: IN_PROGRESS for 2s [ 1184.004900] env[66994]: INFO networking_nsxv3.common.synchronization [None req-117b908e-5277-465d-b5cf-2498f470b6bf tempest-AttachVolumeNegativeTest-1341698298 tempest-AttachVolumeNegativeTest-1341698298-project-member] Enqueued Resource ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 with Priority: HIGHEST for action security_group_rules [ 1184.005477] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 with Priority: HIGHEST for action security_group_rules [ 1184.005807] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-500e0180-c843-4ec5-a6f6-0f2209afd317 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.005934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.005996] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.006302] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.006385] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('500e0180-c843-4ec5-a6f6-0f2209afd317',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.101266] env[66994]: INFO networking_nsxv3.common.synchronization [None req-48c287a9-4c3e-40ee-8d17-01c749dbcfc6 tempest-AttachVolumeNegativeTest-1341698298 tempest-AttachVolumeNegativeTest-1341698298-project-member] Enqueued Resource ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 with Priority: HIGHEST for action security_group_rules [ 1184.101597] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 with Priority: HIGHEST for action security_group_rules [ 1184.101900] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-500e0180-c843-4ec5-a6f6-0f2209afd317 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.102007] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.529779] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.529989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.529989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.530211] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.530304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.530435] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 already deleted. [ 1184.530524] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.530662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.530898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.531010] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('500e0180-c843-4ec5-a6f6-0f2209afd317',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.805330] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: SUCCESS [ 1184.805330] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.055542] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.055663] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.055663] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.055869] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.055959] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.056070] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 already deleted. [ 1185.056198] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.709095] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: SUCCESS [ 1185.709483] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.709689] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.709974] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.710244] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.710401] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.710493] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.710705] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.710811] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.710925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.711079] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.213697] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.214023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.214023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.214209] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.214400] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.214589] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.214589] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.214749] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.214828] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.214930] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.215088] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.215189] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.215245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.215399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.215535] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.215637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.215697] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.215830] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.215900] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.215987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.216095] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.717882] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0030483-0783-4db3-971a-f3155da229b7: rpc.has_security_group_logging(os_id): False [ 1186.740333] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.740486] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.740558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.740799] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.740890] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.741092] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.741192] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.741254] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.741405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.741498] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.741700] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.741794] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.741857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.741994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.742079] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.742272] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.742460] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.742532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.742675] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.742750] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.742832] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be updated. [ 1186.806617] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.806798] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.806841] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.807081] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.807239] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.826406] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: IN_PROGRESS for 2s [ 1188.851222] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: SUCCESS [ 1188.851541] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.102248] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1189.102376] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1189.659991] env[66994]: INFO networking_nsxv3.common.synchronization [req-09e00fb5-8e05-464a-92b1-49f9e0dacb69 req-33d88557-19ab-42e0-8939-b4c51443e07b tempest-AttachVolumeNegativeTest-1341698298 tempest-AttachVolumeNegativeTest-1341698298-project-member] Enqueued Resource ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 with Priority: HIGHEST for action security_group_members [ 1189.660552] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 with Priority: HIGHEST for action security_group_members [ 1189.660870] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-500e0180-c843-4ec5-a6f6-0f2209afd317 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.660999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.661080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.661341] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.661835] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.661835] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.661835] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.661835] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.661988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.661988] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('500e0180-c843-4ec5-a6f6-0f2209afd317',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.006034] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-532 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.006418] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-532" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.006418] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-532" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.006742] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-532" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.006981] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.007279] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.007424] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.007652] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.007795] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.008066] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1190.008194] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1190.008301] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1190.008433] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1190.008550] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1190.008657] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1190.008789] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1190.031956] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1190.031956] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1190.031956] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1190.031956] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-532" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.032491] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-de433906-059d-42c5-9e0e-b039662738f3 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.032642] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-de433906-059d-42c5-9e0e-b039662738f3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.032753] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-de433906-059d-42c5-9e0e-b039662738f3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.033095] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-de433906-059d-42c5-9e0e-b039662738f3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.033236] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de433906-059d-42c5-9e0e-b039662738f3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.164540] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.164723] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.164767] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.165447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.165447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.165573] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.165643] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.165687] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.165834] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.165909] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.165988] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 already deleted. [ 1190.166619] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.536287] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.536287] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.536287] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.536611] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.536753] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.536909] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port de433906-059d-42c5-9e0e-b039662738f3 not found, creating... [ 1190.537247] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.537472] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.537678] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.537820] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.538127] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.538474] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.538676] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.538796] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.539018] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.539156] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.539301] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: de433906-059d-42c5-9e0e-b039662738f3 is going to be created. [ 1190.559807] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.560017] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.560155] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.560431] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.560663] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.560896] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-de433906-059d-42c5-9e0e-b039662738f3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.288071] env[66994]: INFO networking_nsxv3.common.synchronization [req-09e00fb5-8e05-464a-92b1-49f9e0dacb69 req-9f640385-bb04-40e9-89f6-b710332f72a2 service nova] Enqueued Resource ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 with Priority: HIGHEST for action security_group_rules [ 1191.288791] env[66994]: INFO networking_nsxv3.common.synchronization [req-09e00fb5-8e05-464a-92b1-49f9e0dacb69 req-9f640385-bb04-40e9-89f6-b710332f72a2 service nova] Enqueued Resource ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 with Priority: HIGHEST for action security_group_members [ 1191.288863] env[66994]: INFO networking_nsxv3.common.synchronization [req-09e00fb5-8e05-464a-92b1-49f9e0dacb69 req-9f640385-bb04-40e9-89f6-b710332f72a2 service nova] Enqueued Resource ID: de433906-059d-42c5-9e0e-b039662738f3 with Priority: HIGHEST for action port [ 1191.289468] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 with Priority: HIGHEST for action security_group_rules [ 1191.289613] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 with Priority: HIGHEST for action security_group_members [ 1191.289710] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de433906-059d-42c5-9e0e-b039662738f3 with Priority: HIGHEST for action port [ 1191.289999] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-500e0180-c843-4ec5-a6f6-0f2209afd317 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.290118] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.290185] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.290552] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.290552] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('500e0180-c843-4ec5-a6f6-0f2209afd317',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.291311] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-500e0180-c843-4ec5-a6f6-0f2209afd317 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.291416] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.291480] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.291673] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.291856] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.291970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.292044] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.292199] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.292793] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.292793] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('500e0180-c843-4ec5-a6f6-0f2209afd317',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.293615] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-de433906-059d-42c5-9e0e-b039662738f3 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.293615] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de433906-059d-42c5-9e0e-b039662738f3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.293615] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de433906-059d-42c5-9e0e-b039662738f3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.293615] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de433906-059d-42c5-9e0e-b039662738f3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.293615] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de433906-059d-42c5-9e0e-b039662738f3',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.543828] env[66994]: INFO networking_nsxv3.common.synchronization [req-4c1548b5-abc7-44ae-8b4b-abe8e3c29076 req-780f7dc1-7664-4b95-9328-e876ed318791 tempest-AttachInterfacesTestJSON-1437683655 tempest-AttachInterfacesTestJSON-1437683655-project-member] Enqueued Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1191.544711] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1191.545362] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.545540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.545637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.545934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.546214] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.546395] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.546504] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.546757] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.546879] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.546985] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.795073] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('500e0180-c843-4ec5-a6f6-0f2209afd317',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.796267] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-500e0180-c843-4ec5-a6f6-0f2209afd317 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.796422] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.796752] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de433906-059d-42c5-9e0e-b039662738f3 with status ACTIVE [ 1191.796901] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.797021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.797076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.797311] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.797435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.797627] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.797727] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.797786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.797941] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.798028] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.798206] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.798297] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.798384] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.798541] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.798602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.798685] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de433906-059d-42c5-9e0e-b039662738f3 is going to be updated. [ 1191.822041] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.822225] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.822274] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.822500] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.822687] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.822862] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de433906-059d-42c5-9e0e-b039662738f3" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.049819] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.204707] env[66994]: INFO networking_nsxv3.common.synchronization [None req-fe2d174f-0b6f-4c2b-8b4c-c3649513d188 tempest-AttachInterfacesTestJSON-1437683655 tempest-AttachInterfacesTestJSON-1437683655-project-member] Enqueued Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1192.205729] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1192.205729] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.206017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.298547] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('500e0180-c843-4ec5-a6f6-0f2209afd317',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.381021] env[66994]: INFO networking_nsxv3.common.synchronization [req-5e8fd85b-0a80-4eba-bb8d-18884536dea3 req-5e59da23-839d-4181-881b-9b06cc611c28 tempest-ServerActionsTestOtherA-355769928 tempest-ServerActionsTestOtherA-355769928-project-member] Enqueued Resource ID: 086f38af-0633-4270-b4b2-f416d2945ae1 with Priority: HIGHEST for action security_group_members [ 1192.382253] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 086f38af-0633-4270-b4b2-f416d2945ae1 with Priority: HIGHEST for action security_group_members [ 1192.382924] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-086f38af-0633-4270-b4b2-f416d2945ae1 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.383076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.383150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.383514] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.383786] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.383956] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.384036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.384206] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.384296] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.384397] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('086f38af-0633-4270-b4b2-f416d2945ae1',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.552635] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.800633] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.800928] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.801056] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.801330] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.801461] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.801608] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 is going to be created. [ 1192.829533] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.829533] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.829533] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.829533] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.830119] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.843523] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 in Status: UNINITIALIZED for 2s [ 1192.887193] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.887386] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.887441] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.887757] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.888015] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.888169] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.888307] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.888614] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.889091] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.889091] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.889091] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 086f38af-0633-4270-b4b2-f416d2945ae1 is going to be updated. [ 1192.923340] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.923554] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.923611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.923824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.923970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.934664] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 086f38af-0633-4270-b4b2-f416d2945ae1 in Status: IN_PROGRESS for 2s [ 1193.055098] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.055264] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.055353] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.055576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.055667] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.055770] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa is going to be updated. [ 1193.087899] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.088046] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.088126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.088336] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.088571] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.098899] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: IN_PROGRESS for 2s [ 1194.854989] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 in Status: SUCCESS [ 1194.855435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.855577] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.855900] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.856230] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.856454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.856564] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.856831] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.856966] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.857112] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.857261] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('500e0180-c843-4ec5-a6f6-0f2209afd317',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.948918] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 086f38af-0633-4270-b4b2-f416d2945ae1 in Status: SUCCESS [ 1194.949152] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 086f38af-0633-4270-b4b2-f416d2945ae1 deletion is rescheduled due to dependency. [ 1194.949722] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-086f38af-0633-4270-b4b2-f416d2945ae1" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.109249] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: SUCCESS [ 1195.109547] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.109778] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.110037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.110300] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.110494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.110584] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.110763] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.110870] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.111132] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.253456] env[66994]: INFO networking_nsxv3.common.synchronization [req-b4dd6229-dcf5-40d1-b6a6-78d3aa30645e req-e3d5ee98-7e40-4c84-80e5-9e50a458f050 tempest-AttachInterfacesTestJSON-1437683655 tempest-AttachInterfacesTestJSON-1437683655-project-member] Enqueued Resource ID: 661b2c26-8339-44c8-bda6-1d75548802e0 with Priority: HIGHEST for action security_group_members [ 1195.254170] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 661b2c26-8339-44c8-bda6-1d75548802e0 with Priority: HIGHEST for action security_group_members [ 1195.254527] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-661b2c26-8339-44c8-bda6-1d75548802e0 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.254654] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.254723] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.254955] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.255129] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.255519] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.255519] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.255519] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.255519] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.255712] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('661b2c26-8339-44c8-bda6-1d75548802e0',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.360654] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('500e0180-c843-4ec5-a6f6-0f2209afd317',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.613946] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.614173] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.614173] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.614446] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.614569] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.614793] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.614938] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.615046] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.615334] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.615399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.615458] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa is going to be updated. [ 1195.645117] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.645288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.645348] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.645580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.645736] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.655897] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: IN_PROGRESS for 2s [ 1195.757829] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.758036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.758082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.758294] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.758428] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.758653] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.758757] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.758820] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.758979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.759072] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.759161] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 661b2c26-8339-44c8-bda6-1d75548802e0 is going to be updated. [ 1195.788018] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.788224] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.788269] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.788662] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.788852] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.800180] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 661b2c26-8339-44c8-bda6-1d75548802e0 in Status: IN_PROGRESS for 2s [ 1195.862768] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 500e0180-c843-4ec5-a6f6-0f2209afd317: rpc.has_security_group_logging(os_id): False [ 1195.881993] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.882232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.882232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.882525] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.882643] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.882891] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.883061] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.883117] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.883307] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.883421] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.883537] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 is going to be created. [ 1195.945481] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.945629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.945721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.945969] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.946336] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.958931] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 in Status: IN_PROGRESS for 2s [ 1197.666780] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: SUCCESS [ 1197.667035] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa deletion is rescheduled due to dependency. [ 1197.667267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.863863] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 661b2c26-8339-44c8-bda6-1d75548802e0 in Status: SUCCESS [ 1197.864097] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 661b2c26-8339-44c8-bda6-1d75548802e0 deletion is rescheduled due to dependency. [ 1197.864232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.972148] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 in Status: SUCCESS [ 1197.972435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.255192] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1200.255485] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1201.536687] env[66994]: INFO networking_nsxv3.common.synchronization [req-84eb5a8e-4180-42c8-bcc4-0619c5e1d8f9 req-53833a15-d432-4089-8f82-8dd9af6d0faf tempest-ServerActionsTestJSON-501116813 tempest-ServerActionsTestJSON-501116813-project-member] Enqueued Resource ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf with Priority: HIGHEST for action security_group_members [ 1201.537366] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf with Priority: HIGHEST for action security_group_members [ 1201.537876] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fc519de-4252-44ff-ace7-b0a5f3000ccf taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.537876] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.538051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.538283] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.538443] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.538572] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.538638] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.538846] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.538958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.539108] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fc519de-4252-44ff-ace7-b0a5f3000ccf',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.042546] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.042729] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.042768] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.043016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.043114] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.043319] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.043420] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.043484] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.043648] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.043724] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.043813] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf is going to be updated. [ 1202.073024] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.073335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.073417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.073624] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.073817] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.084506] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf in Status: IN_PROGRESS for 2s [ 1202.086446] env[66994]: INFO networking_nsxv3.common.synchronization [req-05062ec1-815b-4d39-bd27-0ef1541a9102 req-8d4cae8c-1e26-4df6-8e79-81f4de41fa9b tempest-AttachVolumeShelveTestJSON-810060241 tempest-AttachVolumeShelveTestJSON-810060241-project-member] Enqueued Resource ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 with Priority: HIGHEST for action security_group_members [ 1202.087567] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 with Priority: HIGHEST for action security_group_members [ 1202.087567] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.087567] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.087567] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.087788] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.087873] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.087966] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.088038] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.088183] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.088264] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.088358] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.192998] env[66994]: INFO networking_nsxv3.common.synchronization [None req-0c032355-b407-4131-ba1a-3884d5a0e746 tempest-AttachInterfacesTestJSON-1437683655 tempest-AttachInterfacesTestJSON-1437683655-project-member] Enqueued Resource ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 with Priority: HIGHEST for action security_group_rules [ 1202.193730] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 with Priority: HIGHEST for action security_group_rules [ 1202.193855] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18b42095-7bb8-4ea4-a397-e90957ef9f27 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.193969] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.194043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.194316] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.194403] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.308090] env[66994]: INFO networking_nsxv3.common.synchronization [None req-fad3cae8-6ac2-4e60-b4ef-e03f7a164c88 tempest-AttachInterfacesTestJSON-1437683655 tempest-AttachInterfacesTestJSON-1437683655-project-member] Enqueued Resource ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 with Priority: HIGHEST for action security_group_rules [ 1202.308751] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 with Priority: HIGHEST for action security_group_rules [ 1202.309743] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18b42095-7bb8-4ea4-a397-e90957ef9f27 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.310164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.590872] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.591235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.591235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.591328] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.591377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.591586] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.591687] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.591743] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.591896] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.591965] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.592067] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 is going to be updated. [ 1202.624385] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.624580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.624580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.624998] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.625133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.636269] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 in Status: IN_PROGRESS for 2s [ 1202.715869] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.716043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.716109] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.716325] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.716415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.716532] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 already deleted. [ 1202.716620] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.716781] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.717208] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.717208] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.240559] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.240779] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.240840] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.241064] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.241163] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.241284] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 already deleted. [ 1203.241372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.666356] env[66994]: INFO networking_nsxv3.common.synchronization [req-bbcce33b-b24f-441a-a0a3-0ec9273813da req-8aa73d63-2569-47af-b2ea-de3e78dd65b7 tempest-ServerActionsTestOtherA-355769928 tempest-ServerActionsTestOtherA-355769928-project-member] Enqueued Resource ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 with Priority: HIGHEST for action security_group_members [ 1203.666823] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 with Priority: HIGHEST for action security_group_members [ 1203.667445] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-82eee1f9-542d-4c43-a79d-01ed4a642272 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.667445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.667445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.667654] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.667654] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.667736] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.670188] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.670188] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.670188] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.670188] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82eee1f9-542d-4c43-a79d-01ed4a642272',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.013171] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-732 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.013171] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-732" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.013171] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-732" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.013171] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-732" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.013631] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.013952] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.014209] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.014532] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.014796] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.015129] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1204.015371] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1204.015587] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1204.015823] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1204.016078] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1204.016308] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1204.016551] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1204.038342] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1204.038342] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1204.038342] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1204.038342] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-732" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.038342] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-61a96358-ee32-4bce-847d-bfa8c185dea9 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.038342] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-61a96358-ee32-4bce-847d-bfa8c185dea9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.038342] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-61a96358-ee32-4bce-847d-bfa8c185dea9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.038342] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-61a96358-ee32-4bce-847d-bfa8c185dea9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.038342] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61a96358-ee32-4bce-847d-bfa8c185dea9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.094459] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf in Status: SUCCESS [ 1204.094459] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf deletion is rescheduled due to dependency. [ 1204.094459] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.172655] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.172655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.172655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.172655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.172655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.172911] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.172911] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.172911] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.173232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.173232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.173232] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 is going to be updated. [ 1204.198155] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.198358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.198358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.198753] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.198928] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.207607] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 in Status: IN_PROGRESS for 2s [ 1204.541013] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.541276] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.541402] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.541699] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.541853] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.542012] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 61a96358-ee32-4bce-847d-bfa8c185dea9 not found, creating... [ 1204.542276] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.542437] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.542545] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.542764] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.542897] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.543194] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.543343] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.543455] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.543657] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.543854] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.543991] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 61a96358-ee32-4bce-847d-bfa8c185dea9 is going to be created. [ 1204.563834] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.564067] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.564193] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.564451] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.564666] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.564890] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-61a96358-ee32-4bce-847d-bfa8c185dea9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.646977] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 in Status: SUCCESS [ 1204.647195] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 deletion is rescheduled due to dependency. [ 1204.647322] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.257111] env[66994]: INFO networking_nsxv3.common.synchronization [req-bbcce33b-b24f-441a-a0a3-0ec9273813da req-421458a1-28ce-4339-9d91-c69abb1a667d service nova] Enqueued Resource ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 with Priority: HIGHEST for action security_group_rules [ 1205.257363] env[66994]: INFO networking_nsxv3.common.synchronization [req-bbcce33b-b24f-441a-a0a3-0ec9273813da req-421458a1-28ce-4339-9d91-c69abb1a667d service nova] Enqueued Resource ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 with Priority: HIGHEST for action security_group_members [ 1205.257434] env[66994]: INFO networking_nsxv3.common.synchronization [req-bbcce33b-b24f-441a-a0a3-0ec9273813da req-421458a1-28ce-4339-9d91-c69abb1a667d service nova] Enqueued Resource ID: 61a96358-ee32-4bce-847d-bfa8c185dea9 with Priority: HIGHEST for action port [ 1205.257659] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 with Priority: HIGHEST for action security_group_rules [ 1205.257823] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 with Priority: HIGHEST for action security_group_members [ 1205.257887] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61a96358-ee32-4bce-847d-bfa8c185dea9 with Priority: HIGHEST for action port [ 1205.258438] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82eee1f9-542d-4c43-a79d-01ed4a642272 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.258696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.258696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.258908] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.258954] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82eee1f9-542d-4c43-a79d-01ed4a642272',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.260235] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-82eee1f9-542d-4c43-a79d-01ed4a642272 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.260235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.260440] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-61a96358-ee32-4bce-847d-bfa8c185dea9 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.260563] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61a96358-ee32-4bce-847d-bfa8c185dea9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.260647] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61a96358-ee32-4bce-847d-bfa8c185dea9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.260856] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61a96358-ee32-4bce-847d-bfa8c185dea9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.260946] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61a96358-ee32-4bce-847d-bfa8c185dea9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.762424] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-82eee1f9-542d-4c43-a79d-01ed4a642272 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.762580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.762924] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61a96358-ee32-4bce-847d-bfa8c185dea9 with status ACTIVE [ 1205.763171] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.763335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.763435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.763720] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.763843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.764104] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.764283] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.764314] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.764546] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.764653] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.764899] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.765025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.765077] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.765248] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.765410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.765540] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61a96358-ee32-4bce-847d-bfa8c185dea9 is going to be updated. [ 1205.790073] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.790353] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.790353] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.790538] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.790677] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.790835] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61a96358-ee32-4bce-847d-bfa8c185dea9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.218957] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 in Status: SUCCESS [ 1206.219135] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 deletion is rescheduled due to dependency. [ 1206.219261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.219520] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.219698] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.220236] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.220236] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.220236] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.220236] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.220423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.220423] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82eee1f9-542d-4c43-a79d-01ed4a642272',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.722924] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('82eee1f9-542d-4c43-a79d-01ed4a642272',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.225108] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('82eee1f9-542d-4c43-a79d-01ed4a642272',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.728498] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.728498] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.728885] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.729043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.729156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.729256] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 is going to be updated. [ 1207.761419] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.761610] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.761674] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.761877] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.762035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.772659] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 in Status: IN_PROGRESS for 2s [ 1209.784845] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 in Status: SUCCESS [ 1209.785128] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.785267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.785484] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.785668] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.785786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.785850] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.785997] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.786092] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.786173] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.786265] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('82eee1f9-542d-4c43-a79d-01ed4a642272',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.258927] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1210.259091] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1210.289968] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-82eee1f9-542d-4c43-a79d-01ed4a642272 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.290153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.290219] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.290436] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.290610] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.290717] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.290782] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.290934] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.291033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.291126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.291275] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-82eee1f9-542d-4c43-a79d-01ed4a642272 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.291366] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.291425] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.291564] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.291697] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.291784] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.291842] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.291973] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.292058] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.292138] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.292226] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('82eee1f9-542d-4c43-a79d-01ed4a642272',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.794190] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 82eee1f9-542d-4c43-a79d-01ed4a642272: rpc.has_security_group_logging(os_id): False [ 1210.812583] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.812771] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.812817] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.813012] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.813110] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.813298] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.813397] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.813482] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.813611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.813688] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.813884] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.813977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.814055] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.814199] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.814273] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.814442] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.814534] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.814594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.814747] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.814824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.814910] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 is going to be updated. [ 1210.887045] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.887045] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.887045] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.887045] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.887045] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.900511] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 in Status: IN_PROGRESS for 2s [ 1211.997818] env[66994]: INFO networking_nsxv3.common.synchronization [req-fb7191b3-d5f4-4dc7-874a-4a8e35c740d1 req-df0be47a-58b1-4a7c-98ae-87bb35a0f45c tempest-AttachInterfacesTestJSON-1437683655 tempest-AttachInterfacesTestJSON-1437683655-project-member] Enqueued Resource ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 with Priority: HIGHEST for action security_group_members [ 1211.998372] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 with Priority: HIGHEST for action security_group_members [ 1211.998728] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-18b42095-7bb8-4ea4-a397-e90957ef9f27 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.998841] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.998916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.999284] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.999348] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.000363] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.000363] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.000363] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.000363] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.000363] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.300247] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.300498] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.302077] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.302077] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.302077] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.302077] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.302077] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.302340] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.302571] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.302944] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1212.303455] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1212.303595] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1212.303752] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1212.303896] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1212.304410] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1212.304960] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1212.326072] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1212.326259] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1212.326415] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1212.326706] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.327086] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-7c1513ef-650b-4b38-bf1d-2ffd1a834c66 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.327293] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-7c1513ef-650b-4b38-bf1d-2ffd1a834c66" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.327452] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-7c1513ef-650b-4b38-bf1d-2ffd1a834c66" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.329556] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-7c1513ef-650b-4b38-bf1d-2ffd1a834c66" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.329556] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c1513ef-650b-4b38-bf1d-2ffd1a834c66',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.503230] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.503400] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.503444] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.503669] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.503761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.503960] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.504076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.504138] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.504291] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.504366] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.504485] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 already deleted. [ 1212.504533] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.831827] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.832065] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.832197] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.832466] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.832734] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.832833] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 7c1513ef-650b-4b38-bf1d-2ffd1a834c66 not found, creating... [ 1212.833018] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.833184] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.833298] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.833521] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.833642] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.833915] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.834079] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.834191] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.834386] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.834515] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.834690] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 7c1513ef-650b-4b38-bf1d-2ffd1a834c66 is going to be created. [ 1212.855945] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.856184] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.856306] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.856576] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.857365] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.857789] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-7c1513ef-650b-4b38-bf1d-2ffd1a834c66" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.924260] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 in Status: SUCCESS [ 1212.924260] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.606076] env[66994]: INFO networking_nsxv3.common.synchronization [req-fb7191b3-d5f4-4dc7-874a-4a8e35c740d1 req-d8187f7e-dfb0-4f02-bb4d-51c0ad2dd58b service nova] Enqueued Resource ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 with Priority: HIGHEST for action security_group_rules [ 1213.606076] env[66994]: INFO networking_nsxv3.common.synchronization [req-fb7191b3-d5f4-4dc7-874a-4a8e35c740d1 req-d8187f7e-dfb0-4f02-bb4d-51c0ad2dd58b service nova] Enqueued Resource ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 with Priority: HIGHEST for action security_group_members [ 1213.606076] env[66994]: INFO networking_nsxv3.common.synchronization [req-fb7191b3-d5f4-4dc7-874a-4a8e35c740d1 req-d8187f7e-dfb0-4f02-bb4d-51c0ad2dd58b service nova] Enqueued Resource ID: 7c1513ef-650b-4b38-bf1d-2ffd1a834c66 with Priority: HIGHEST for action port [ 1213.606076] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 with Priority: HIGHEST for action security_group_rules [ 1213.606076] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 with Priority: HIGHEST for action security_group_members [ 1213.606076] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c1513ef-650b-4b38-bf1d-2ffd1a834c66 with Priority: HIGHEST for action port [ 1213.606687] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18b42095-7bb8-4ea4-a397-e90957ef9f27 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.606756] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.606841] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.607232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.607232] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.608457] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-18b42095-7bb8-4ea4-a397-e90957ef9f27 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.608565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.608674] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.608848] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.608999] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.609986] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.609986] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.609986] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.609986] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.609986] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.612749] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c1513ef-650b-4b38-bf1d-2ffd1a834c66 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.612749] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c1513ef-650b-4b38-bf1d-2ffd1a834c66" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.612749] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c1513ef-650b-4b38-bf1d-2ffd1a834c66" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.612749] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c1513ef-650b-4b38-bf1d-2ffd1a834c66" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.612749] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c1513ef-650b-4b38-bf1d-2ffd1a834c66',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.109689] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-18b42095-7bb8-4ea4-a397-e90957ef9f27 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.109995] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.112213] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.114208] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c1513ef-650b-4b38-bf1d-2ffd1a834c66 with status ACTIVE [ 1214.114407] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.114527] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.114601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.114799] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.114894] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.115066] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.115166] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.115218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.115365] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.115430] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.115608] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.115698] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.115741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.115880] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.115952] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.116050] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c1513ef-650b-4b38-bf1d-2ffd1a834c66 is going to be updated. [ 1214.137727] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.137899] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.137940] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.138165] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.138302] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.138460] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c1513ef-650b-4b38-bf1d-2ffd1a834c66" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.618414] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.121331] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.121507] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.121566] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.121785] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.121879] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.121980] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 is going to be created. [ 1215.148993] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.149191] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.149238] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.149476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.149641] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.159328] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 in Status: UNINITIALIZED for 2s [ 1215.294983] env[66994]: INFO networking_nsxv3.common.synchronization [req-ec0cebea-875a-4b4a-a651-72367cb7ab7a req-b0184220-989e-41ca-9c7c-e18a5bb5a71d tempest-ServerActionsTestOtherA-355769928 tempest-ServerActionsTestOtherA-355769928-project-member] Enqueued Resource ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 with Priority: HIGHEST for action security_group_members [ 1215.295579] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 with Priority: HIGHEST for action security_group_members [ 1215.295949] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-82eee1f9-542d-4c43-a79d-01ed4a642272 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.296105] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.296176] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.296383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.296553] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.296691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.296758] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.296906] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.296994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.297103] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82eee1f9-542d-4c43-a79d-01ed4a642272',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.342576] env[66994]: INFO networking_nsxv3.common.synchronization [req-ec0cebea-875a-4b4a-a651-72367cb7ab7a req-b0184220-989e-41ca-9c7c-e18a5bb5a71d tempest-ServerActionsTestOtherA-355769928 tempest-ServerActionsTestOtherA-355769928-project-member] Enqueued Resource ID: 61a96358-ee32-4bce-847d-bfa8c185dea9 with Priority: HIGHEST for action port [ 1215.343664] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61a96358-ee32-4bce-847d-bfa8c185dea9 with Priority: HIGHEST for action port [ 1215.344206] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-61a96358-ee32-4bce-847d-bfa8c185dea9 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.344412] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61a96358-ee32-4bce-847d-bfa8c185dea9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.344532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61a96358-ee32-4bce-847d-bfa8c185dea9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.344844] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61a96358-ee32-4bce-847d-bfa8c185dea9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.344987] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61a96358-ee32-4bce-847d-bfa8c185dea9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.799124] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.799463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.799463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.799604] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.799763] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.799972] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.800128] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.800186] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.800333] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.800407] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.800495] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 is going to be updated. [ 1215.826672] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.826856] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.826910] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.827109] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.827260] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.837057] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 in Status: IN_PROGRESS for 2s [ 1215.847486] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61a96358-ee32-4bce-847d-bfa8c185dea9 with status ACTIVE [ 1215.847719] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.847850] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.847922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.848150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.848241] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.848419] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.848519] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.848579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.848933] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.849233] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.849504] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.849600] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.849644] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.849843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.850068] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.850068] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61a96358-ee32-4bce-847d-bfa8c185dea9 is going to be updated. [ 1215.871487] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.871664] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.871726] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.872063] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.872160] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.872235] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61a96358-ee32-4bce-847d-bfa8c185dea9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.993200] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-729 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.993720] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-729" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.993720] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-729" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.993872] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-729" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.994211] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.994419] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.994545] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.994772] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.994921] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.995174] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1216.995289] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1216.995395] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1216.995503] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1216.995611] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1216.995717] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1216.995853] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1217.016300] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1217.016495] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1217.016703] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1217.016895] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-729" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.017228] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-738aff9c-8c13-48f3-aa10-507f02af90ac taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.017403] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-738aff9c-8c13-48f3-aa10-507f02af90ac" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.017523] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-738aff9c-8c13-48f3-aa10-507f02af90ac" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.017792] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-738aff9c-8c13-48f3-aa10-507f02af90ac" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.017930] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('738aff9c-8c13-48f3-aa10-507f02af90ac',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.168844] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 in Status: SUCCESS [ 1217.169088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.169264] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.169489] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.169706] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.169817] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.169896] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.170064] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.170138] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.170266] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.170322] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.520983] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.521234] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.521360] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.521650] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.521799] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.522107] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.522263] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.522378] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.522592] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.522734] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.523015] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.523185] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.523299] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.523501] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.523640] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.523776] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 738aff9c-8c13-48f3-aa10-507f02af90ac is going to be updated. [ 1217.545480] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.545712] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.545788] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.546058] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.546248] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.546471] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-738aff9c-8c13-48f3-aa10-507f02af90ac" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.672355] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.848983] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 in Status: SUCCESS [ 1217.849156] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 deletion is rescheduled due to dependency. [ 1217.849221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.175443] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18b42095-7bb8-4ea4-a397-e90957ef9f27: rpc.has_security_group_logging(os_id): False [ 1218.192767] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.192917] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.192971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.193225] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.193326] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.193529] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.193626] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.193690] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.193841] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.194067] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.194067] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 is going to be created. [ 1218.229468] env[66994]: INFO networking_nsxv3.common.synchronization [req-45c28b82-7b21-403e-81b3-743d44dcb191 req-d6ec5157-dbc5-4eef-9307-332a91719019 service nova] Enqueued Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_rules [ 1218.229589] env[66994]: INFO networking_nsxv3.common.synchronization [req-45c28b82-7b21-403e-81b3-743d44dcb191 req-d6ec5157-dbc5-4eef-9307-332a91719019 service nova] Enqueued Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_members [ 1218.229759] env[66994]: INFO networking_nsxv3.common.synchronization [req-45c28b82-7b21-403e-81b3-743d44dcb191 req-d6ec5157-dbc5-4eef-9307-332a91719019 service nova] Enqueued Resource ID: 738aff9c-8c13-48f3-aa10-507f02af90ac with Priority: HIGHEST for action port [ 1218.230269] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_rules [ 1218.230607] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_members [ 1218.230607] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738aff9c-8c13-48f3-aa10-507f02af90ac with Priority: HIGHEST for action port [ 1218.230789] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.230912] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.230984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.231228] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.231290] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.232159] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.232639] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.232696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.232832] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.232981] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.233089] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.233149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.233290] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.233373] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.233460] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.235966] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-738aff9c-8c13-48f3-aa10-507f02af90ac taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.236062] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-738aff9c-8c13-48f3-aa10-507f02af90ac" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.236388] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-738aff9c-8c13-48f3-aa10-507f02af90ac" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.236388] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-738aff9c-8c13-48f3-aa10-507f02af90ac" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.236388] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('738aff9c-8c13-48f3-aa10-507f02af90ac',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.256486] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.256486] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.256486] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.256862] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.256927] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.269446] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 in Status: IN_PROGRESS for 2s [ 1218.737937] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.740071] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.740071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.740071] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 738aff9c-8c13-48f3-aa10-507f02af90ac with status ACTIVE [ 1218.740071] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.740071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.740071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.740071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.740071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.740430] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.740430] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.740430] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.740536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.740536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.740724] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.740813] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.740871] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.741039] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.741126] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.741210] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 738aff9c-8c13-48f3-aa10-507f02af90ac is going to be updated. [ 1218.786123] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.786277] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.786345] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.786565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.786702] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.786859] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-738aff9c-8c13-48f3-aa10-507f02af90ac" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.243473] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.746472] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.746684] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.746754] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.746956] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.747073] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.747179] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e is going to be updated. [ 1219.774436] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.774636] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.774636] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.774925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.775087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.784447] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: IN_PROGRESS for 2s [ 1220.282784] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 in Status: SUCCESS [ 1220.283065] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.794505] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: SUCCESS [ 1221.794798] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.794906] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.795198] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.795358] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.795466] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.795532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.795685] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.795766] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.795852] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.795944] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.300062] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.802093] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24a08da7-cf3b-41d4-b7f4-8e3b7616589e: rpc.has_security_group_logging(os_id): False [ 1222.821181] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.821452] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.821548] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.821769] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.821921] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.822237] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.822565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.822565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.822867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.822867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.822867] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e is going to be updated. [ 1222.881677] env[66994]: INFO networking_nsxv3.common.synchronization [req-b68a9584-a7dd-4ef6-82ae-3cf810e13c96 req-2a0670d8-96cb-443f-b4f8-088c2ca1023c tempest-DeleteServersTestJSON-15988793 tempest-DeleteServersTestJSON-15988793-project-member] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1222.882433] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGHEST for action security_group_members [ 1222.882553] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.882675] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.882765] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.882927] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.883146] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.883416] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.883495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.883665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.883737] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.883837] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.889286] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.889286] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.889286] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.889286] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.889286] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.907307] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: IN_PROGRESS for 2s [ 1223.387645] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.387811] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.387879] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.388166] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.388250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.388679] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.389489] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.389584] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.389778] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.389894] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.389992] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be updated. [ 1223.421619] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.421825] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.422282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.422512] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.423323] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.433536] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: IN_PROGRESS for 2s [ 1224.925720] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: SUCCESS [ 1224.926099] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.447115] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0030483-0783-4db3-971a-f3155da229b7 in Status: SUCCESS [ 1225.447115] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0030483-0783-4db3-971a-f3155da229b7 deletion is rescheduled due to dependency. [ 1225.447115] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.869436] env[66994]: INFO networking_nsxv3.common.synchronization [req-dd728cb4-abc5-4b3e-9c42-8c05bbb985ac req-860e3607-ddd6-46e0-95bc-6f6aa98acfb8 tempest-AttachInterfacesTestJSON-1437683655 tempest-AttachInterfacesTestJSON-1437683655-project-member] Enqueued Resource ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 with Priority: HIGHEST for action security_group_members [ 1227.869957] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 with Priority: HIGHEST for action security_group_members [ 1227.870280] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-18b42095-7bb8-4ea4-a397-e90957ef9f27 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.870402] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.870463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.870711] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.870801] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.870898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.870947] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.871106] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.871182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.871273] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.175226] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.175410] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.175557] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.175918] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.176215] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.176381] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.176495] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.176735] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.176919] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.177241] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1228.177425] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1228.177491] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1228.177606] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1228.178363] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1228.178363] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1228.178363] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1228.199457] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1228.199611] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1228.199736] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1228.199908] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.200247] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-9a0aa7e2-e84f-44fb-bd50-f1eb5fd89335 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.200415] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-9a0aa7e2-e84f-44fb-bd50-f1eb5fd89335" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.200530] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-9a0aa7e2-e84f-44fb-bd50-f1eb5fd89335" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.200947] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-9a0aa7e2-e84f-44fb-bd50-f1eb5fd89335" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.201151] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a0aa7e2-e84f-44fb-bd50-f1eb5fd89335',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.374100] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.703351] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.703547] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.703685] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.703992] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.704212] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.704373] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 9a0aa7e2-e84f-44fb-bd50-f1eb5fd89335 not found, creating... [ 1228.704633] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.704844] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.704963] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.705277] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.705368] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.705662] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.705826] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.705980] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.706247] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.706396] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.706564] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 9a0aa7e2-e84f-44fb-bd50-f1eb5fd89335 is going to be created. [ 1228.732353] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.732612] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.732743] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.733101] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.733372] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.733624] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-9a0aa7e2-e84f-44fb-bd50-f1eb5fd89335" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.875846] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.380640] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.380640] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.380640] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.380640] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.380640] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.380640] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 is going to be updated. [ 1229.415033] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.415033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.415033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.415033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.415033] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.425961] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 in Status: IN_PROGRESS for 2s [ 1229.449296] env[66994]: INFO networking_nsxv3.common.synchronization [req-dd728cb4-abc5-4b3e-9c42-8c05bbb985ac req-37c0c315-001e-4f65-9e86-9da4be4a6cd6 service nova] Enqueued Resource ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 with Priority: HIGHEST for action security_group_rules [ 1229.449296] env[66994]: INFO networking_nsxv3.common.synchronization [req-dd728cb4-abc5-4b3e-9c42-8c05bbb985ac req-37c0c315-001e-4f65-9e86-9da4be4a6cd6 service nova] Enqueued Resource ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 with Priority: HIGHEST for action security_group_members [ 1229.449296] env[66994]: INFO networking_nsxv3.common.synchronization [req-dd728cb4-abc5-4b3e-9c42-8c05bbb985ac req-37c0c315-001e-4f65-9e86-9da4be4a6cd6 service nova] Enqueued Resource ID: 9a0aa7e2-e84f-44fb-bd50-f1eb5fd89335 with Priority: HIGHEST for action port [ 1229.449296] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 with Priority: HIGHEST for action security_group_rules [ 1229.449296] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 with Priority: HIGHEST for action security_group_members [ 1229.450100] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a0aa7e2-e84f-44fb-bd50-f1eb5fd89335 with Priority: HIGHEST for action port [ 1229.450655] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18b42095-7bb8-4ea4-a397-e90957ef9f27 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.452362] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.452561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.452888] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.453150] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.456201] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-18b42095-7bb8-4ea4-a397-e90957ef9f27 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.456201] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.456201] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a0aa7e2-e84f-44fb-bd50-f1eb5fd89335 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.459159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a0aa7e2-e84f-44fb-bd50-f1eb5fd89335" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.459159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a0aa7e2-e84f-44fb-bd50-f1eb5fd89335" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.459159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a0aa7e2-e84f-44fb-bd50-f1eb5fd89335" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.459159] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a0aa7e2-e84f-44fb-bd50-f1eb5fd89335',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.957098] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-18b42095-7bb8-4ea4-a397-e90957ef9f27 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.957392] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.960690] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a0aa7e2-e84f-44fb-bd50-f1eb5fd89335 with status ACTIVE [ 1229.960918] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.961096] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.961249] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.961478] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.961582] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.961779] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.961884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.961949] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.962181] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.962298] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.962502] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.962601] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.962664] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.962854] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.962905] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.962948] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a0aa7e2-e84f-44fb-bd50-f1eb5fd89335 is going to be updated. [ 1229.986487] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.986487] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.986487] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.986487] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.986487] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.986487] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a0aa7e2-e84f-44fb-bd50-f1eb5fd89335" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.435608] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 in Status: SUCCESS [ 1231.435894] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.435984] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.436228] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.437080] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.437080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.437080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.437080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.437080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.437080] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.938836] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.441077] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.944052] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.944052] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.944052] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.944346] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.944399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.944674] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 is going to be updated. [ 1232.977412] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.977609] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.977650] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.977953] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.978156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.988646] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 in Status: IN_PROGRESS for 2s [ 1234.451136] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1234.451418] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1235.000531] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 in Status: SUCCESS [ 1235.000734] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.000924] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.001176] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.001398] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.001523] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.001586] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.001742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.001822] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.001908] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.002034] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.503913] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.007072] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18b42095-7bb8-4ea4-a397-e90957ef9f27: rpc.has_security_group_logging(os_id): False [ 1236.049887] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.049887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.049887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.050263] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.050356] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.050774] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.050947] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.051290] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.051583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.051717] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.051866] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 is going to be updated. [ 1236.123498] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.123790] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.123790] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.123924] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.124129] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.140579] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 in Status: IN_PROGRESS for 2s [ 1237.503415] env[66994]: INFO networking_nsxv3.common.synchronization [req-65651f6b-8984-49d8-9bc1-b2d31c75d22c req-eae841a9-763e-47be-9e62-20f7f923e2ab tempest-ServerActionsTestOtherB-1891732265 tempest-ServerActionsTestOtherB-1891732265-project-member] Enqueued Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_members [ 1237.504612] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGHEST for action security_group_members [ 1237.505476] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.505476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.505476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.505476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.505842] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.505842] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.505842] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.506086] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.506374] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.506502] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.010372] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.010372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.010372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.010372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.010372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.010372] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.010372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.010372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.010372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.010372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.011160] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e is going to be updated. [ 1238.042041] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.042256] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.042256] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.042416] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.042607] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.053787] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: IN_PROGRESS for 2s [ 1238.154351] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 in Status: SUCCESS [ 1238.154571] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.065957] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e in Status: SUCCESS [ 1240.066353] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e deletion is rescheduled due to dependency. [ 1240.066353] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.259573] env[66994]: INFO networking_nsxv3.common.synchronization [None req-656f9cb2-067b-4e99-8272-4617a3ef972f tempest-AttachInterfacesTestJSON-1437683655 tempest-AttachInterfacesTestJSON-1437683655-project-member] Enqueued Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1240.260332] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1240.260792] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.260970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.261561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.261561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.261561] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.261730] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.261795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.261985] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.261985] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.262224] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.765604] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.765883] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.765997] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.766372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.766504] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.766870] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.767029] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.767101] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.767427] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.767576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.767696] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa is going to be updated. [ 1240.796499] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.796761] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.796859] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.797162] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.797358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.807547] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: IN_PROGRESS for 2s [ 1241.216693] env[66994]: INFO networking_nsxv3.common.synchronization [req-940b4ff8-8359-4523-b051-ac4679380a2b req-6d052c9a-83f6-4569-8807-b21ac09b020f tempest-ServerActionsTestOtherA-355769928 tempest-ServerActionsTestOtherA-355769928-project-member] Enqueued Resource ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 with Priority: HIGHEST for action security_group_members [ 1241.216693] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 with Priority: HIGHEST for action security_group_members [ 1241.216693] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.216693] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.216693] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.216693] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.216693] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.216693] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.220621] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.220621] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.220621] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.220903] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.588118] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-732 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.588329] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-732" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.588477] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-732" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.588786] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-732" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.589194] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.589455] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.589541] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.589764] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.589899] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.590187] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1241.590330] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1241.590496] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1241.590592] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1241.590713] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1241.591157] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1241.591157] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1241.611399] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1241.611582] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1241.611719] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1241.611902] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-732" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.612249] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-8720dbb9-b71d-4cfd-b68a-0c11e7fe7c9b taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.612497] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-8720dbb9-b71d-4cfd-b68a-0c11e7fe7c9b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.612581] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-8720dbb9-b71d-4cfd-b68a-0c11e7fe7c9b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.612899] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-8720dbb9-b71d-4cfd-b68a-0c11e7fe7c9b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.613088] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8720dbb9-b71d-4cfd-b68a-0c11e7fe7c9b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.723803] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.823946] env[66994]: INFO networking_nsxv3.common.synchronization [req-aa8f2b1a-49a4-4f39-97f8-61af8be790ff req-ed3de231-ea4f-4e72-b8b1-6a88c42abb8a tempest-ServerActionsTestJSON-501116813 tempest-ServerActionsTestJSON-501116813-project-member] Enqueued Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_members [ 1241.824538] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_members [ 1241.824853] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a75cae-9123-4d4d-9e51-add1196ab1f2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.824974] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.825055] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.825261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.825410] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.825507] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.825568] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.825709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.825793] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.825884] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.120937] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.120937] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.120937] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.120937] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.122138] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.122138] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 8720dbb9-b71d-4cfd-b68a-0c11e7fe7c9b not found, creating... [ 1242.122138] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.122138] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.122138] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.122138] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.122138] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.122379] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.122530] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.122641] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.122841] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.122975] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.126595] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 8720dbb9-b71d-4cfd-b68a-0c11e7fe7c9b is going to be created. [ 1242.150681] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.150897] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.151035] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.151351] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.151596] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.151896] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-8720dbb9-b71d-4cfd-b68a-0c11e7fe7c9b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.226373] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.327844] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.328043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.328089] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.328882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.328882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.328882] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.328882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.328882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.328882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.329178] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.329178] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 is going to be updated. [ 1242.394696] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.394884] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.394923] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.395148] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.395289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.405218] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: IN_PROGRESS for 2s [ 1242.728789] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.729026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.729087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.729303] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.729399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.729519] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 is going to be updated. [ 1242.763648] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.763827] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.763906] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.764195] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.764380] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.787721] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 in Status: IN_PROGRESS for 2s [ 1242.817437] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: SUCCESS [ 1242.817666] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa deletion is rescheduled due to dependency. [ 1242.817804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.918833] env[66994]: INFO networking_nsxv3.common.synchronization [req-940b4ff8-8359-4523-b051-ac4679380a2b req-7d32a505-0cb0-4cd5-8809-6d0a1a97f86c service nova] Enqueued Resource ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 with Priority: HIGHEST for action security_group_rules [ 1242.919124] env[66994]: INFO networking_nsxv3.common.synchronization [req-940b4ff8-8359-4523-b051-ac4679380a2b req-7d32a505-0cb0-4cd5-8809-6d0a1a97f86c service nova] Enqueued Resource ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 with Priority: HIGHEST for action security_group_members [ 1242.919283] env[66994]: INFO networking_nsxv3.common.synchronization [req-940b4ff8-8359-4523-b051-ac4679380a2b req-7d32a505-0cb0-4cd5-8809-6d0a1a97f86c service nova] Enqueued Resource ID: 8720dbb9-b71d-4cfd-b68a-0c11e7fe7c9b with Priority: HIGHEST for action port [ 1242.919786] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 with Priority: HIGHEST for action security_group_rules [ 1242.919920] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 with Priority: HIGHEST for action security_group_members [ 1242.920064] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8720dbb9-b71d-4cfd-b68a-0c11e7fe7c9b with Priority: HIGHEST for action port [ 1242.920331] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.920455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.920541] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.920722] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.920805] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.922453] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.922602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.922854] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-8720dbb9-b71d-4cfd-b68a-0c11e7fe7c9b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.922941] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8720dbb9-b71d-4cfd-b68a-0c11e7fe7c9b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.922978] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8720dbb9-b71d-4cfd-b68a-0c11e7fe7c9b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.923633] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8720dbb9-b71d-4cfd-b68a-0c11e7fe7c9b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.923633] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8720dbb9-b71d-4cfd-b68a-0c11e7fe7c9b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.425439] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.425797] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.425797] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8720dbb9-b71d-4cfd-b68a-0c11e7fe7c9b with status ACTIVE [ 1243.425944] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.426072] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.426139] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.426351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.426441] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.426611] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.426705] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.426783] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.426944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.427081] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.427355] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.427629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.427721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.427923] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.428030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.428157] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8720dbb9-b71d-4cfd-b68a-0c11e7fe7c9b is going to be updated. [ 1243.450693] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.450875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.450875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.450992] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.451152] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.451381] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8720dbb9-b71d-4cfd-b68a-0c11e7fe7c9b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.414685] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: SUCCESS [ 1244.414883] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 deletion is rescheduled due to dependency. [ 1244.414976] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.808089] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 in Status: SUCCESS [ 1244.808393] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.808551] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.808768] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.808952] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.809218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.809289] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.809451] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.809530] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.809628] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.312013] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.815219] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.205115] env[66994]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1246.205288] env[66994]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1246.317781] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.317781] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.319049] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.319049] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.319049] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.319049] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 is going to be updated. [ 1246.358230] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.358427] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.358427] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.358721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.358791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.371036] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 in Status: IN_PROGRESS for 2s [ 1247.921190] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1247.921475] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1248.382550] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 in Status: SUCCESS [ 1248.382831] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.383066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.383317] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.383520] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.383650] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.383776] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.383879] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.384574] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.384574] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.384574] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.887413] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.238056] env[66994]: INFO networking_nsxv3.common.synchronization [req-6edbe2f4-ff48-4558-a9e9-5fca7293599a req-3714c05e-b103-436c-9cb2-0ff443a2045d tempest-ServerActionsTestJSON-501116813 tempest-ServerActionsTestJSON-501116813-project-member] Enqueued Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_members [ 1249.238304] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_members [ 1249.238609] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a75cae-9123-4d4d-9e51-add1196ab1f2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.238733] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.238799] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.238995] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.239225] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.239327] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.239388] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.239539] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.239624] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.239716] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.390235] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a66f6cb4-94dc-4701-ac62-f6c6e4d4e305: rpc.has_security_group_logging(os_id): False [ 1249.411864] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.412428] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.412738] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.412974] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.433880] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.434215] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.434354] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.434414] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.434603] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.434665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.434759] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 is going to be updated. [ 1249.500153] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.500379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.500379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.500575] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.500719] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.514731] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 in Status: IN_PROGRESS for 2s [ 1249.540463] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-736 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.540663] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-736" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.540784] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-736" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.541063] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-736" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.541710] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.541889] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.542013] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.542241] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.542384] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.542592] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1249.542704] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1249.542812] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1249.542918] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1249.543037] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1249.543147] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1249.543276] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1249.562081] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1249.562261] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1249.562399] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1249.562563] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-736" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.562870] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-7e55a279-d81d-4ad0-a930-097761b1912c taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.563059] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-7e55a279-d81d-4ad0-a930-097761b1912c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.563360] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-7e55a279-d81d-4ad0-a930-097761b1912c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.563697] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-7e55a279-d81d-4ad0-a930-097761b1912c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.563837] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e55a279-d81d-4ad0-a930-097761b1912c',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.743103] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.743304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.743376] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.743561] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.743655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.743859] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.743959] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.744035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.744193] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.744269] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.744356] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 is going to be updated. [ 1249.771980] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.772221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.772221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.772455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.772562] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.785062] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: IN_PROGRESS for 2s [ 1250.066609] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.066839] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.067070] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.067347] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.067497] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.067649] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 7e55a279-d81d-4ad0-a930-097761b1912c not found, creating... [ 1250.067917] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.068088] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.068216] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.068447] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.068605] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.068940] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.069193] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.069307] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.069518] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.069650] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.069790] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 7e55a279-d81d-4ad0-a930-097761b1912c is going to be created. [ 1250.091586] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.091816] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.091975] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.092312] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.092583] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.092842] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-7e55a279-d81d-4ad0-a930-097761b1912c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.803826] env[66994]: INFO networking_nsxv3.common.synchronization [req-6edbe2f4-ff48-4558-a9e9-5fca7293599a req-7b19fd38-77b2-4ad4-823e-52cf6e2a002c service nova] Enqueued Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_rules [ 1250.804100] env[66994]: INFO networking_nsxv3.common.synchronization [req-6edbe2f4-ff48-4558-a9e9-5fca7293599a req-7b19fd38-77b2-4ad4-823e-52cf6e2a002c service nova] Enqueued Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_members [ 1250.804215] env[66994]: INFO networking_nsxv3.common.synchronization [req-6edbe2f4-ff48-4558-a9e9-5fca7293599a req-7b19fd38-77b2-4ad4-823e-52cf6e2a002c service nova] Enqueued Resource ID: 7e55a279-d81d-4ad0-a930-097761b1912c with Priority: HIGHEST for action port [ 1250.804736] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_rules [ 1250.804870] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_members [ 1250.804965] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e55a279-d81d-4ad0-a930-097761b1912c with Priority: HIGHEST for action port [ 1250.805257] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88a75cae-9123-4d4d-9e51-add1196ab1f2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.805385] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.805451] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.805692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.805780] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.806652] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a75cae-9123-4d4d-9e51-add1196ab1f2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.806748] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.807523] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e55a279-d81d-4ad0-a930-097761b1912c taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.807523] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e55a279-d81d-4ad0-a930-097761b1912c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.807523] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e55a279-d81d-4ad0-a930-097761b1912c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.807523] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e55a279-d81d-4ad0-a930-097761b1912c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.807523] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e55a279-d81d-4ad0-a930-097761b1912c',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.309193] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a75cae-9123-4d4d-9e51-add1196ab1f2 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.309443] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.310748] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e55a279-d81d-4ad0-a930-097761b1912c with status ACTIVE [ 1251.313074] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.313074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.313074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.313074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.313074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.313074] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.313074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.313074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.313074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.313074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.313074] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.313074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.313074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.313074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.313074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.313074] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e55a279-d81d-4ad0-a930-097761b1912c is going to be updated. [ 1251.334719] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.334907] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.334950] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.335132] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.335267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.335423] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e55a279-d81d-4ad0-a930-097761b1912c" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.534055] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 in Status: SUCCESS [ 1251.534055] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.797353] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: SUCCESS [ 1251.797353] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 deletion is rescheduled due to dependency. [ 1251.797353] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.797353] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.797353] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.797353] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.797353] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.797770] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.797770] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.797770] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.797770] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.299720] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.802553] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.995981] env[66994]: INFO networking_nsxv3.common.synchronization [req-b9b5b861-1af4-4200-8312-4273833f3505 req-0bc4c97e-f021-46a4-855f-db3393009049 tempest-AttachVolumeNegativeTest-1341698298 tempest-AttachVolumeNegativeTest-1341698298-project-member] Enqueued Resource ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 with Priority: HIGHEST for action security_group_members [ 1252.996563] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 with Priority: HIGHEST for action security_group_members [ 1252.996871] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-500e0180-c843-4ec5-a6f6-0f2209afd317 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.996991] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.997135] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.997340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.997491] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.997599] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.997658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.997803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.997870] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.997946] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('500e0180-c843-4ec5-a6f6-0f2209afd317',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.304678] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.304964] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.304964] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.306147] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.306147] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.306147] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 is going to be updated. [ 1253.338461] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.338639] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.338639] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.338949] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.339457] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.351462] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: IN_PROGRESS for 2s [ 1253.502118] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.502324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.502424] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.502748] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.502900] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.503225] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.503367] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.503479] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.503718] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.503837] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.503972] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 is going to be updated. [ 1253.537729] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.537929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.537972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.538186] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.538335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.551742] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 in Status: IN_PROGRESS for 2s [ 1255.366049] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: SUCCESS [ 1255.366049] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.366049] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.366049] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.366049] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.366049] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.366049] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.366736] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.366736] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.366736] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.366736] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.562250] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 in Status: SUCCESS [ 1255.562494] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 deletion is rescheduled due to dependency. [ 1255.562643] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.869459] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.371079] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88a75cae-9123-4d4d-9e51-add1196ab1f2: rpc.has_security_group_logging(os_id): False [ 1256.389053] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.389053] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.389053] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.389053] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.389053] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.389423] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.389484] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.389525] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.389670] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.389747] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.389833] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 is going to be updated. [ 1256.448548] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.448772] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.448845] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.449201] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.449417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.461659] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: IN_PROGRESS for 2s [ 1257.998176] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1257.998561] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1258.476577] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: SUCCESS [ 1258.476843] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.756620] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.756950] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.756950] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.757266] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.757531] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.757688] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.757803] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.758032] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.758174] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.758381] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1260.758486] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1260.758591] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1260.758694] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1260.758800] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1260.758901] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1260.759038] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1260.790911] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1260.791113] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1260.791241] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1260.791426] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.791842] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-26e809fd-b0b8-426a-a0a3-3995306ce07b taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.792033] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-26e809fd-b0b8-426a-a0a3-3995306ce07b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.792161] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-26e809fd-b0b8-426a-a0a3-3995306ce07b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.792500] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-26e809fd-b0b8-426a-a0a3-3995306ce07b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.792640] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26e809fd-b0b8-426a-a0a3-3995306ce07b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.295695] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.295958] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.295958] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.296270] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.296344] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.297055] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Segment Port 26e809fd-b0b8-426a-a0a3-3995306ce07b not found, creating... [ 1261.297055] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.297055] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.297055] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.297417] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.297606] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.297707] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.297861] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.297978] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.298199] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.298334] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.298471] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: 26e809fd-b0b8-426a-a0a3-3995306ce07b is going to be created. [ 1261.321482] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.321714] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.321794] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.322973] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.322973] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.322973] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-26e809fd-b0b8-426a-a0a3-3995306ce07b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.019820] env[66994]: INFO networking_nsxv3.common.synchronization [req-d185d24f-9d20-4b7a-927d-c9e55cc837df req-a8b9e0a4-6668-405a-8c0d-9f733db52584 service nova] Enqueued Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_rules [ 1262.019820] env[66994]: INFO networking_nsxv3.common.synchronization [req-d185d24f-9d20-4b7a-927d-c9e55cc837df req-a8b9e0a4-6668-405a-8c0d-9f733db52584 service nova] Enqueued Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1262.019820] env[66994]: INFO networking_nsxv3.common.synchronization [req-d185d24f-9d20-4b7a-927d-c9e55cc837df req-a8b9e0a4-6668-405a-8c0d-9f733db52584 service nova] Enqueued Resource ID: 26e809fd-b0b8-426a-a0a3-3995306ce07b with Priority: HIGHEST for action port [ 1262.020402] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_rules [ 1262.020555] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1262.020654] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26e809fd-b0b8-426a-a0a3-3995306ce07b with Priority: HIGHEST for action port [ 1262.020929] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.021167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.021272] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.021508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.021649] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.022496] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.022658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.022754] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.022970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.023161] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.023293] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.023384] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.023558] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.023676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.023790] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.024702] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-26e809fd-b0b8-426a-a0a3-3995306ce07b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.024781] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26e809fd-b0b8-426a-a0a3-3995306ce07b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.024816] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26e809fd-b0b8-426a-a0a3-3995306ce07b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.024979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26e809fd-b0b8-426a-a0a3-3995306ce07b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.025094] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26e809fd-b0b8-426a-a0a3-3995306ce07b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.145632] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.145860] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.145860] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.146163] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.146320] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.526437] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.527649] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.528432] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.528926] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26e809fd-b0b8-426a-a0a3-3995306ce07b with status ACTIVE [ 1262.529238] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.529401] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.529481] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.529796] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.529970] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.530232] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.530380] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.530464] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.530989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.530989] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.530989] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.531253] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.531253] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.531520] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.531657] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.531770] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26e809fd-b0b8-426a-a0a3-3995306ce07b is going to be updated. [ 1262.555612] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.555864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.555864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.556159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.556680] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.556898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26e809fd-b0b8-426a-a0a3-3995306ce07b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.649097] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.029604] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.151981] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.533135] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.533377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.533442] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.533733] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.533847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.533956] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa is going to be updated. [ 1263.564267] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.564553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.564553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.564754] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.564911] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.578660] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: IN_PROGRESS for 2s [ 1263.654213] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1263.654407] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1264.543615] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.543974] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.543974] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.544103] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.560676] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1264.561537] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.562701] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1264.606852] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.607088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.607088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.607322] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.624305] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.625391] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1264.625506] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1264.625628] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1264.671551] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.671696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.671794] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.671967] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.673510] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.673585] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1264.755339] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.755499] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.755549] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.755764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.756179] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.756480] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1264.852063] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.852063] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.852348] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.852474] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.852836] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.853235] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:42. [ 1264.853393] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'88a75cae-9123-4d4d-9e51-add1196ab1f2', '24a08da7-cf3b-41d4-b7f4-8e3b7616589e', 'b62a4f35-964f-404b-ba36-70b4e8cb2dc5', '6dbf99f5-e2f2-4d4a-a2c0-855c798d247f', 'fdc9f3b2-daa7-4881-83a2-d1c73f6b403b', '9e351cb9-ed41-4a93-8257-1a5acb7b4f9e', 'ab40fd20-8903-42f0-a8a2-66a0ed5248f4', '500e0180-c843-4ec5-a6f6-0f2209afd317', '3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9', '82eee1f9-542d-4c43-a79d-01ed4a642272', '9c718081-e5df-4901-a082-56a5b8ccbf2d', 'b0030483-0783-4db3-971a-f3155da229b7', 'd15cba36-9c0e-45f0-8225-a808a551bd40', '0023a3cd-aa32-4af2-a423-608695d50731', '34bde346-4da1-4dd8-ad15-cd1afe320304', '1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21', '3ea9c700-dac6-4282-90b7-8b85af493263', '661b2c26-8339-44c8-bda6-1d75548802e0', '4fdf001c-b425-433f-b4c2-dcd41fc81f02', '11c0b684-9731-4046-89ad-f4bf7b2168d4', 'de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8', '705505ff-4cd1-493a-b249-a5178fb4ee23', 'a6612b52-6412-47ab-8918-14b6b8bca0cb', 'a66f6cb4-94dc-4701-ac62-f6c6e4d4e305', '8ffb70f8-4012-40ec-b9e7-bc37e90e6e70', '7fc519de-4252-44ff-ace7-b0a5f3000ccf', '2f159d71-0083-4a40-882f-2a28e3868c96', '44494650-6b02-4361-a53d-fb11ecaa53f2', 'd88934f6-85c4-4f45-a1fc-042377e3901a', '01dce4c1-af3a-4e00-a26c-16f52625131a', '91e3865c-9322-423a-9d64-5c548ef52da8', '18b42095-7bb8-4ea4-a397-e90957ef9f27', 'd4672e8d-a5ca-46f8-8d7b-adf4da6e472b', '34a807f7-3865-4ec7-9af1-5f447e70423b', '52c814d2-8c46-4f11-a3ab-47d2b96480f7', 'aaddbb4b-3076-42ef-afd8-2dcbedf8773e', '841e623a-3249-4bd3-878a-817068626c8a', '9cde16ce-be95-4b19-a4ea-e24f03fb1476', '086f38af-0633-4270-b4b2-f416d2945ae1', 'e887c3d4-547e-480b-bd4c-f503fcb02ca5', '88bd36a2-b7c7-405c-ba4b-c36eb190f52e', 'b740b91b-8f03-45e7-909b-66803d9ffafa'} {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1264.853506] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1264.874681] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.874872] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.874979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.875269] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.875398] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.875564] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1264.875660] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1264.875745] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1264.978963] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.978963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.978963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.978963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.980592] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.980990] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1264.981135] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1264.981251] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1264.981354] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1264.981935] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/42 resources of Type:Security Group Rules [ 1264.981935] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGH for action security_group_rules [ 1264.981935] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGH for action security_group_rules [ 1264.981935] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGH for action security_group_rules [ 1264.981935] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f with Priority: HIGH for action security_group_rules [ 1264.982113] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fdc9f3b2-daa7-4881-83a2-d1c73f6b403b with Priority: HIGH for action security_group_rules [ 1264.982113] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e with Priority: HIGH for action security_group_rules [ 1264.982229] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 with Priority: HIGH for action security_group_rules [ 1264.982370] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 with Priority: HIGH for action security_group_rules [ 1264.982911] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 with Priority: HIGH for action security_group_rules [ 1264.982911] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 with Priority: HIGH for action security_group_rules [ 1264.982911] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d with Priority: HIGH for action security_group_rules [ 1264.982911] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGH for action security_group_rules [ 1264.982911] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d15cba36-9c0e-45f0-8225-a808a551bd40 with Priority: HIGH for action security_group_rules [ 1264.982911] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0023a3cd-aa32-4af2-a423-608695d50731 with Priority: HIGH for action security_group_rules [ 1264.983254] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 with Priority: HIGH for action security_group_rules [ 1264.983254] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 with Priority: HIGH for action security_group_rules [ 1264.983254] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3ea9c700-dac6-4282-90b7-8b85af493263 with Priority: HIGH for action security_group_rules [ 1264.983338] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 661b2c26-8339-44c8-bda6-1d75548802e0 with Priority: HIGH for action security_group_rules [ 1264.983398] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGH for action security_group_rules [ 1264.983481] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGH for action security_group_rules [ 1264.983613] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.590409] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: SUCCESS [ 1265.590784] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.591326] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.591326] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.591454] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.591529] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.591529] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.591736] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.591783] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.591871] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.591961] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.094999] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.094999] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.095178] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.097258] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.097258] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.097258] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.097258] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.097258] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.097258] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.097258] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.097258] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.097618] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.097618] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.097618] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.097618] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.097774] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.097774] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.097886] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.097957] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.098048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.098135] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.402046] env[66994]: INFO networking_nsxv3.common.synchronization [None req-04b64e17-da3b-432c-98d5-ad7ab6744e41 None None] Enqueued Resource ID: b443ec6c-0c87-418e-8a54-2a1ce7a39bf5 with Priority: HIGHEST for action port [ 1266.402507] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b443ec6c-0c87-418e-8a54-2a1ce7a39bf5 with Priority: HIGHEST for action port [ 1266.402707] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGH for action security_group_rules [ 1266.402751] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 with Priority: HIGH for action security_group_rules [ 1266.402863] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 with Priority: HIGH for action security_group_rules [ 1266.402981] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 with Priority: HIGH for action security_group_rules [ 1266.403206] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 with Priority: HIGH for action security_group_rules [ 1266.403310] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 with Priority: HIGH for action security_group_rules [ 1266.403428] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 661b2c26-8339-44c8-bda6-1d75548802e0 with Priority: HIGH for action security_group_rules [ 1266.403617] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ea9c700-dac6-4282-90b7-8b85af493263 with Priority: HIGH for action security_group_rules [ 1266.403617] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0023a3cd-aa32-4af2-a423-608695d50731 with Priority: HIGH for action security_group_rules [ 1266.403721] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 with Priority: HIGH for action security_group_rules [ 1266.403879] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d15cba36-9c0e-45f0-8225-a808a551bd40 with Priority: HIGH for action security_group_rules [ 1266.403986] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0030483-0783-4db3-971a-f3155da229b7 with Priority: HIGH for action security_group_rules [ 1266.404099] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d with Priority: HIGH for action security_group_rules [ 1266.404339] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 with Priority: HIGH for action security_group_rules [ 1266.404339] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 with Priority: HIGH for action security_group_rules [ 1266.404439] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e with Priority: HIGH for action security_group_rules [ 1266.404471] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 with Priority: HIGH for action security_group_rules [ 1266.404578] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdc9f3b2-daa7-4881-83a2-d1c73f6b403b with Priority: HIGH for action security_group_rules [ 1266.404692] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e with Priority: HIGH for action security_group_rules [ 1266.404842] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f with Priority: HIGH for action security_group_rules [ 1266.405264] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-b443ec6c-0c87-418e-8a54-2a1ce7a39bf5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.405399] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b443ec6c-0c87-418e-8a54-2a1ce7a39bf5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.405528] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b443ec6c-0c87-418e-8a54-2a1ce7a39bf5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.405878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b443ec6c-0c87-418e-8a54-2a1ce7a39bf5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.405878] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b443ec6c-0c87-418e-8a54-2a1ce7a39bf5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.407208] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88a75cae-9123-4d4d-9e51-add1196ab1f2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.407208] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.407208] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.407368] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.407368] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.408493] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.408635] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.408736] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.408928] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.409034] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b62a4f35-964f-404b-ba36-70b4e8cb2dc5',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.409794] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab40fd20-8903-42f0-a8a2-66a0ed5248f4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.409902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.410021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.410311] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.410311] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab40fd20-8903-42f0-a8a2-66a0ed5248f4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.411209] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34bde346-4da1-4dd8-ad15-cd1afe320304 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.411363] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.411467] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.411702] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.411930] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34bde346-4da1-4dd8-ad15-cd1afe320304',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.412549] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11c0b684-9731-4046-89ad-f4bf7b2168d4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.412709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.412941] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.413166] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.413277] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11c0b684-9731-4046-89ad-f4bf7b2168d4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.414160] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fdf001c-b425-433f-b4c2-dcd41fc81f02 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.414383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.414479] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.414637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.414718] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fdf001c-b425-433f-b4c2-dcd41fc81f02',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.415484] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-661b2c26-8339-44c8-bda6-1d75548802e0 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.415591] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.415749] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.415822] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.415892] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('661b2c26-8339-44c8-bda6-1d75548802e0',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.416829] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ea9c700-dac6-4282-90b7-8b85af493263 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.416829] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.416829] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.417055] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.417055] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ea9c700-dac6-4282-90b7-8b85af493263',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.417925] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0023a3cd-aa32-4af2-a423-608695d50731 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.418051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.418344] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.418344] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.418344] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0023a3cd-aa32-4af2-a423-608695d50731',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.420839] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.420839] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.421025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.421065] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.421429] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.421835] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d15cba36-9c0e-45f0-8225-a808a551bd40 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.421981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.422075] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.423027] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.423027] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d15cba36-9c0e-45f0-8225-a808a551bd40',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.423027] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0030483-0783-4db3-971a-f3155da229b7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.423188] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.423188] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.423302] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.423375] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0030483-0783-4db3-971a-f3155da229b7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.424606] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c718081-e5df-4901-a082-56a5b8ccbf2d taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.424717] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.425349] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.425349] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.425349] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c718081-e5df-4901-a082-56a5b8ccbf2d',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.429964] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82eee1f9-542d-4c43-a79d-01ed4a642272 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.431085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.431085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.431085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.431085] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82eee1f9-542d-4c43-a79d-01ed4a642272',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.431963] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.431963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.431963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.431963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.431963] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.432588] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.432704] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.432756] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.432906] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.432976] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e351cb9-ed41-4a93-8257-1a5acb7b4f9e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.433783] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-500e0180-c843-4ec5-a6f6-0f2209afd317 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.433892] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.433944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.434115] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.434188] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('500e0180-c843-4ec5-a6f6-0f2209afd317',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.434845] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.434943] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.435030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.435166] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.435242] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdc9f3b2-daa7-4881-83a2-d1c73f6b403b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.435903] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.436017] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.436082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.436232] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.436312] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24a08da7-cf3b-41d4-b7f4-8e3b7616589e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.437171] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.437291] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.437350] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.437503] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.437575] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dbf99f5-e2f2-4d4a-a2c0-855c798d247f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.443671] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b443ec6c-0c87-418e-8a54-2a1ce7a39bf5 [ 1266.443871] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.444060] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.444060] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.444249] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.444319] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.444431] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b443ec6c-0c87-418e-8a54-2a1ce7a39bf5 already deleted. [ 1266.444502] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b443ec6c-0c87-418e-8a54-2a1ce7a39bf5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.467394] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.467792] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.467792] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.468058] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.474801] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.474940] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.492299] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.492467] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b62a4f35-964f-404b-ba36-70b4e8cb2dc5 is going to be deleted. [ 1266.494531] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.494776] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.519506] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.519692] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11c0b684-9731-4046-89ad-f4bf7b2168d4 is going to be deleted. [ 1266.552043] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.552043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.552043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.552043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.552043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.552043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b62a4f35-964f-404b-ba36-70b4e8cb2dc5" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.582594] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.582856] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.582856] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.582972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.583051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.583167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11c0b684-9731-4046-89ad-f4bf7b2168d4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.600042] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b740b91b-8f03-45e7-909b-66803d9ffafa: rpc.has_security_group_logging(os_id): False [ 1266.625745] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.625745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.625745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.625745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.662036] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.662036] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.662346] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.662346] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.662456] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.662522] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.663250] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.663250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.663250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.663250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.663250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.663250] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.663569] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.663569] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.663698] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.663698] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.663793] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa is going to be updated. [ 1266.777777] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.777985] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.777985] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.778134] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.778291] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.792159] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: IN_PROGRESS for 2s [ 1266.948387] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a75cae-9123-4d4d-9e51-add1196ab1f2 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.948564] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.948696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.948994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.949260] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.949387] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.949447] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.949728] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.949728] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.949813] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.951820] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.998356] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.998488] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.998536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.998755] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.007697] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.007918] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.009637] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.009802] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.020903] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.021079] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.021972] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.022089] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.023953] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.024067] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.024839] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.025055] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.025698] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.025808] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.026513] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.026803] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.027376] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.027528] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.028221] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.028304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.029040] env[66994]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1267.029627] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.029766] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.030561] env[66994]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1267.030942] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.031152] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.031664] env[66994]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1267.032050] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.032142] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.032765] env[66994]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1267.033156] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.033243] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.033850] env[66994]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1267.034256] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.034333] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.034966] env[66994]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1267.035368] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.035482] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.037084] env[66994]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1267.037532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.037837] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab40fd20-8903-42f0-a8a2-66a0ed5248f4 is going to be deleted. [ 1267.038728] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.038942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.059363] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.059557] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 661b2c26-8339-44c8-bda6-1d75548802e0 is going to be deleted. [ 1267.060942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.060942] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.083339] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.083482] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 500e0180-c843-4ec5-a6f6-0f2209afd317 is going to be deleted. [ 1267.084443] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.084592] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.103526] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.103670] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fdf001c-b425-433f-b4c2-dcd41fc81f02 is going to be deleted. [ 1267.104583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.104798] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.119540] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.119697] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.124208] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.124336] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdc9f3b2-daa7-4881-83a2-d1c73f6b403b is going to be deleted. [ 1267.127015] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.127015] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.128217] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.128351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.141013] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.141201] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.154205] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.154205] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ea9c700-dac6-4282-90b7-8b85af493263 is going to be deleted. [ 1267.155127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.155346] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.171063] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.171063] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.180625] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.180778] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82eee1f9-542d-4c43-a79d-01ed4a642272 is going to be deleted. [ 1267.181716] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.181940] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.184130] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.184251] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.227270] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.227430] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21 is going to be deleted. [ 1267.228517] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.228785] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.287346] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.287465] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.309495] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.309775] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.310699] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.310803] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0023a3cd-aa32-4af2-a423-608695d50731 is going to be deleted. [ 1267.311664] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.311806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.378119] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.378269] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c718081-e5df-4901-a082-56a5b8ccbf2d is going to be deleted. [ 1267.379209] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.379455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.432728] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.432882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.449248] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.449396] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e351cb9-ed41-4a93-8257-1a5acb7b4f9e is going to be deleted. [ 1267.450294] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.450669] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.452220] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.452337] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.464472] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.514796] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.514964] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0030483-0783-4db3-971a-f3155da229b7 is going to be deleted. [ 1267.515863] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.516092] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.551049] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.551233] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.551835] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.551931] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.552714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.552828] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24a08da7-cf3b-41d4-b7f4-8e3b7616589e is going to be deleted. [ 1267.553705] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.554016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.604653] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.605207] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34bde346-4da1-4dd8-ad15-cd1afe320304 is going to be deleted. [ 1267.606125] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.609798] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.678306] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.678546] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9 is going to be deleted. [ 1267.679725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.679908] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.701186] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.701186] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.725463] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.725463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.750611] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.750787] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dbf99f5-e2f2-4d4a-a2c0-855c798d247f is going to be deleted. [ 1267.752065] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.752355] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.784350] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.784536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.798336] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.798484] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d15cba36-9c0e-45f0-8225-a808a551bd40 is going to be deleted. [ 1267.799514] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.799738] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.799893] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.799963] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab40fd20-8903-42f0-a8a2-66a0ed5248f4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.800155] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.800455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.800490] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.800708] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-661b2c26-8339-44c8-bda6-1d75548802e0" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.801285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.801459] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.801586] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.801660] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-500e0180-c843-4ec5-a6f6-0f2209afd317" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.801790] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.801935] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.802019] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.802133] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fdf001c-b425-433f-b4c2-dcd41fc81f02" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.802264] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.802408] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.802483] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.802593] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdc9f3b2-daa7-4881-83a2-d1c73f6b403b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.802728] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.802857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.802928] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.803052] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ea9c700-dac6-4282-90b7-8b85af493263" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.803462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.803462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.803462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.803462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82eee1f9-542d-4c43-a79d-01ed4a642272" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.803630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.803896] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.803896] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.803896] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f82790e-a97b-4f6c-8b1b-e9dad2fb0a21" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.804046] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.804167] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.804207] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.804320] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0023a3cd-aa32-4af2-a423-608695d50731" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.804445] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.804580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.804665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.804743] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e351cb9-ed41-4a93-8257-1a5acb7b4f9e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.804870] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.805014] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.805089] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.805198] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c718081-e5df-4901-a082-56a5b8ccbf2d" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.805353] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.805505] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.805505] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.805633] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0030483-0783-4db3-971a-f3155da229b7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.805743] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.805878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.805949] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.806071] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24a08da7-cf3b-41d4-b7f4-8e3b7616589e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.806208] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.806340] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.806417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.806527] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34bde346-4da1-4dd8-ad15-cd1afe320304" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.851967] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.852177] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.852220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.852444] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.852589] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.852645] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c6c4b4b-09bc-4a37-a1eb-f34a04357ad9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.903731] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.903731] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.904040] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.904040] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.904150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.904238] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dbf99f5-e2f2-4d4a-a2c0-855c798d247f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.932631] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.932820] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.932880] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.933097] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.933189] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.933300] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d15cba36-9c0e-45f0-8225-a808a551bd40" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.967869] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88a75cae-9123-4d4d-9e51-add1196ab1f2: rpc.has_security_group_logging(os_id): False [ 1268.012784] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.013030] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.013144] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.013448] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.049155] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.049514] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.049642] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.049710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.049986] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.049986] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.050118] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 is going to be updated. [ 1268.121460] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.121587] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.121676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.122308] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.122308] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.136085] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: IN_PROGRESS for 2s [ 1268.816958] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: SUCCESS [ 1268.816958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.263447] env[66994]: INFO networking_nsxv3.common.synchronization [None req-e5657e67-9cfa-4950-885a-4801b05017c6 None None] Enqueued Resource ID: 1a0ff339-abb0-4a7e-ac05-5f4d6e8eeacb with Priority: HIGHEST for action port [ 1269.263836] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a0ff339-abb0-4a7e-ac05-5f4d6e8eeacb with Priority: HIGHEST for action port [ 1269.264146] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a0ff339-abb0-4a7e-ac05-5f4d6e8eeacb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.264267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a0ff339-abb0-4a7e-ac05-5f4d6e8eeacb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.264331] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a0ff339-abb0-4a7e-ac05-5f4d6e8eeacb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.264579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a0ff339-abb0-4a7e-ac05-5f4d6e8eeacb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.264662] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a0ff339-abb0-4a7e-ac05-5f4d6e8eeacb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.766427] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a0ff339-abb0-4a7e-ac05-5f4d6e8eeacb [ 1269.766668] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.766826] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.766916] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.767159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.767272] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.767376] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a0ff339-abb0-4a7e-ac05-5f4d6e8eeacb already deleted. [ 1269.767455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a0ff339-abb0-4a7e-ac05-5f4d6e8eeacb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.152217] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: SUCCESS [ 1270.152576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.293552] env[66994]: INFO networking_nsxv3.common.synchronization [req-edcc7dd0-d940-4cdd-8966-ae16105b108d req-e1391b7e-db81-4ffa-a6ce-8d516ebe7582 tempest-ServersNegativeTestJSON-1687938332 tempest-ServersNegativeTestJSON-1687938332-project-member] Enqueued Resource ID: e01a5513-045d-4e42-a158-09a37391b50b with Priority: HIGHEST for action security_group_members [ 1272.294106] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e01a5513-045d-4e42-a158-09a37391b50b with Priority: HIGHEST for action security_group_members [ 1272.294411] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e01a5513-045d-4e42-a158-09a37391b50b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.294536] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.294603] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.294849] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.295081] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.295153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.295228] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.295578] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.295688] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.295806] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.587072] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-132 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.587409] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-132" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.587574] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-132" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.587899] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-132" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.588345] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.588573] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.588650] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.588860] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.589013] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.589225] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1272.589384] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1272.589495] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1272.589599] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1272.589705] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1272.589804] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1272.589935] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1272.613690] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1272.613886] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1272.613993] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1272.614187] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-132" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.618028] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-c6e2293a-4e6c-46e8-a146-231b4ef957a9 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.618028] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-c6e2293a-4e6c-46e8-a146-231b4ef957a9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.618028] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-c6e2293a-4e6c-46e8-a146-231b4ef957a9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.618028] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-c6e2293a-4e6c-46e8-a146-231b4ef957a9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.618028] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6e2293a-4e6c-46e8-a146-231b4ef957a9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.800565] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.800780] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.800823] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.801037] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.801140] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.801360] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.801464] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.801527] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.801721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.801804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.801892] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e01a5513-045d-4e42-a158-09a37391b50b already deleted. [ 1272.801972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.119080] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.119080] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.119080] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.119080] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.119508] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.119508] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port c6e2293a-4e6c-46e8-a146-231b4ef957a9 not found, creating... [ 1273.119730] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.119886] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.119999] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.120245] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.120426] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.120724] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.120878] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.120991] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.121334] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.121479] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.121667] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: c6e2293a-4e6c-46e8-a146-231b4ef957a9 is going to be created. [ 1273.141648] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.141909] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.142036] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.142301] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.142531] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.142748] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-c6e2293a-4e6c-46e8-a146-231b4ef957a9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.891326] env[66994]: INFO networking_nsxv3.common.synchronization [req-edcc7dd0-d940-4cdd-8966-ae16105b108d req-3502fe47-be22-4e99-ba01-23929367b105 service nova] Enqueued Resource ID: e01a5513-045d-4e42-a158-09a37391b50b with Priority: HIGHEST for action security_group_rules [ 1273.891606] env[66994]: INFO networking_nsxv3.common.synchronization [req-edcc7dd0-d940-4cdd-8966-ae16105b108d req-3502fe47-be22-4e99-ba01-23929367b105 service nova] Enqueued Resource ID: e01a5513-045d-4e42-a158-09a37391b50b with Priority: HIGHEST for action security_group_members [ 1273.891717] env[66994]: INFO networking_nsxv3.common.synchronization [req-edcc7dd0-d940-4cdd-8966-ae16105b108d req-3502fe47-be22-4e99-ba01-23929367b105 service nova] Enqueued Resource ID: c6e2293a-4e6c-46e8-a146-231b4ef957a9 with Priority: HIGHEST for action port [ 1273.892205] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e01a5513-045d-4e42-a158-09a37391b50b with Priority: HIGHEST for action security_group_rules [ 1273.892337] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e01a5513-045d-4e42-a158-09a37391b50b with Priority: HIGHEST for action security_group_members [ 1273.892434] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6e2293a-4e6c-46e8-a146-231b4ef957a9 with Priority: HIGHEST for action port [ 1273.892712] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e01a5513-045d-4e42-a158-09a37391b50b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.892839] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.892906] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.893972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.895480] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.896585] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e01a5513-045d-4e42-a158-09a37391b50b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.897946] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.898035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.898347] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.898512] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.898614] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.898676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.898823] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.898913] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.899013] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.900353] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6e2293a-4e6c-46e8-a146-231b4ef957a9 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.900511] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6e2293a-4e6c-46e8-a146-231b4ef957a9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.900645] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6e2293a-4e6c-46e8-a146-231b4ef957a9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.900820] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6e2293a-4e6c-46e8-a146-231b4ef957a9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.900884] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6e2293a-4e6c-46e8-a146-231b4ef957a9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.402918] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e01a5513-045d-4e42-a158-09a37391b50b taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.403113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.403248] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.406055] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6e2293a-4e6c-46e8-a146-231b4ef957a9 with status ACTIVE [ 1274.406232] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.406348] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.406433] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.406637] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.406725] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.406899] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.406993] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.407079] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.407642] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.407642] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.407642] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.407642] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.407642] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.407981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.407981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.407981] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6e2293a-4e6c-46e8-a146-231b4ef957a9 is going to be updated. [ 1274.429684] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.429895] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.429944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.430228] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.430449] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.430632] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6e2293a-4e6c-46e8-a146-231b4ef957a9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.906123] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.408240] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.408431] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.408472] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.408758] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.408857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.408956] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e01a5513-045d-4e42-a158-09a37391b50b is going to be created. [ 1275.432855] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.433051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.433051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.433228] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.433387] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.443791] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e01a5513-045d-4e42-a158-09a37391b50b in Status: UNINITIALIZED for 2s [ 1277.454841] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e01a5513-045d-4e42-a158-09a37391b50b in Status: SUCCESS [ 1277.455164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.455241] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.455463] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.455680] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.455819] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.455887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.456066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.456147] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.456231] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.456319] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.527026] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.527251] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.527405] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.527729] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.527985] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.528159] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.528275] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.528489] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.528634] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.528835] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1277.528949] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1277.529068] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1277.529175] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1277.529280] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1277.529409] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1277.529551] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1277.547383] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1277.547619] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1277.547763] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1277.547936] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-887" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.548263] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-26e809fd-b0b8-426a-a0a3-3995306ce07b taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.548436] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-26e809fd-b0b8-426a-a0a3-3995306ce07b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.548556] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-26e809fd-b0b8-426a-a0a3-3995306ce07b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.548809] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-26e809fd-b0b8-426a-a0a3-3995306ce07b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.548943] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26e809fd-b0b8-426a-a0a3-3995306ce07b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.959257] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e01a5513-045d-4e42-a158-09a37391b50b taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.959477] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.959541] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.959762] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.959933] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.960044] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.960107] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.960255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.960355] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.960492] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.960743] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e01a5513-045d-4e42-a158-09a37391b50b taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.960858] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.960921] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.961083] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.961222] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.961318] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.961374] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.961511] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.961587] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.961665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.961752] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.051694] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.051694] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.051694] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.051969] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.051969] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.052197] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.052355] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.052473] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.052683] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.052816] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.053104] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.053260] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.053378] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.053583] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.053718] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.053856] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 26e809fd-b0b8-426a-a0a3-3995306ce07b is going to be updated. [ 1278.075722] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.075944] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.076080] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.076375] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.076580] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.076809] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-26e809fd-b0b8-426a-a0a3-3995306ce07b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.464444] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e01a5513-045d-4e42-a158-09a37391b50b: rpc.has_security_group_logging(os_id): False [ 1278.481934] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.482306] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.482306] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.482585] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.482809] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.483043] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.483205] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.483308] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.483528] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.483667] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.484216] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.484216] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.484216] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.484556] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.484556] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.484783] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.484930] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.485188] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.485271] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.485374] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.485509] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e01a5513-045d-4e42-a158-09a37391b50b is going to be created. [ 1278.543269] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.543471] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.543538] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.543700] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.543873] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.553981] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e01a5513-045d-4e42-a158-09a37391b50b in Status: IN_PROGRESS for 2s [ 1278.760950] env[66994]: INFO networking_nsxv3.common.synchronization [req-6f260e70-a071-4745-963b-4347a544e8f8 req-166d665a-7196-4993-8e77-76e468cb4082 service nova] Enqueued Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_rules [ 1278.760950] env[66994]: INFO networking_nsxv3.common.synchronization [req-6f260e70-a071-4745-963b-4347a544e8f8 req-166d665a-7196-4993-8e77-76e468cb4082 service nova] Enqueued Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1278.761070] env[66994]: INFO networking_nsxv3.common.synchronization [req-6f260e70-a071-4745-963b-4347a544e8f8 req-166d665a-7196-4993-8e77-76e468cb4082 service nova] Enqueued Resource ID: 26e809fd-b0b8-426a-a0a3-3995306ce07b with Priority: HIGHEST for action port [ 1278.761574] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_rules [ 1278.761715] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1278.761816] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26e809fd-b0b8-426a-a0a3-3995306ce07b with Priority: HIGHEST for action port [ 1278.762262] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.762357] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.762427] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.762629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.762711] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.764820] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.764988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.765080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.765511] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.765549] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.765675] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.765783] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.765977] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.766278] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.766278] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.767841] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-26e809fd-b0b8-426a-a0a3-3995306ce07b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.767958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26e809fd-b0b8-426a-a0a3-3995306ce07b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.768046] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26e809fd-b0b8-426a-a0a3-3995306ce07b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.768208] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26e809fd-b0b8-426a-a0a3-3995306ce07b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.768291] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26e809fd-b0b8-426a-a0a3-3995306ce07b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.265725] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.265937] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.270206] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.272740] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26e809fd-b0b8-426a-a0a3-3995306ce07b with status ACTIVE [ 1279.272903] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.273026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.273093] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.273293] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.273379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.273544] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.273665] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.273711] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.273838] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.273909] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.274092] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.274218] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.274254] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.274496] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.274570] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.274654] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26e809fd-b0b8-426a-a0a3-3995306ce07b is going to be updated. [ 1279.298043] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.298227] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.298271] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.298444] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.298578] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.298733] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26e809fd-b0b8-426a-a0a3-3995306ce07b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.772654] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.276039] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.276222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.276294] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.276574] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.276667] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.276769] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa is going to be updated. [ 1280.306884] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.307072] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.307121] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.307379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.307563] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.321072] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: IN_PROGRESS for 2s [ 1280.566962] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e01a5513-045d-4e42-a158-09a37391b50b in Status: SUCCESS [ 1280.567221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.331428] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: SUCCESS [ 1282.331910] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.331910] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.332073] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.332224] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.332344] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.332422] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.332681] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.332800] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.332938] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.333098] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.836021] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.836220] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.836272] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.836500] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.836674] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.836811] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.836908] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.837184] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.837320] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.837478] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.837698] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.837848] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.837945] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.838166] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.838311] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.838405] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.838468] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.838607] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.838732] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.838777] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.838882] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.341970] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b740b91b-8f03-45e7-909b-66803d9ffafa: rpc.has_security_group_logging(os_id): False [ 1283.359189] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.359341] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.359472] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.359688] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.359780] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.359976] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.360093] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.360178] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.360295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.360371] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.360581] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.360672] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.360737] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.360869] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.360941] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.361138] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.361226] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.361288] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.361415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.361487] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.361568] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa is going to be updated. [ 1283.435125] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.435280] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.435345] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.435555] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.435697] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.447963] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: IN_PROGRESS for 2s [ 1283.762804] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1283.762980] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1285.464270] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: SUCCESS [ 1285.464690] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.921222] env[66994]: INFO networking_nsxv3.common.synchronization [req-fc2095d0-0dab-4e3c-a5f5-d2518471cb39 req-ee462bdb-7a4c-4fd1-8a07-b5b7a885e15f tempest-ServersNegativeTestJSON-1687938332 tempest-ServersNegativeTestJSON-1687938332-project-member] Enqueued Resource ID: e01a5513-045d-4e42-a158-09a37391b50b with Priority: HIGHEST for action security_group_members [ 1287.921756] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e01a5513-045d-4e42-a158-09a37391b50b with Priority: HIGHEST for action security_group_members [ 1287.922226] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e01a5513-045d-4e42-a158-09a37391b50b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.922412] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.922494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.922694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.922851] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.922950] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.923023] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.923164] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.923246] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.923343] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.206315] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-132 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.206517] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-132" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.206639] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-132" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.206910] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-132" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.207176] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.207331] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.207454] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.207677] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.207993] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.208126] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1288.208240] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1288.208350] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1288.208462] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1288.208571] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1288.208673] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1288.208800] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1288.229926] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1288.230117] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1288.230754] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1288.230754] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-132" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.230898] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-e2ddc440-45ba-4e88-941a-dd8fd21ea4b6 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.231103] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-e2ddc440-45ba-4e88-941a-dd8fd21ea4b6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.231310] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-e2ddc440-45ba-4e88-941a-dd8fd21ea4b6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.231647] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-e2ddc440-45ba-4e88-941a-dd8fd21ea4b6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.231807] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2ddc440-45ba-4e88-941a-dd8fd21ea4b6',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.425364] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.734672] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.734864] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.734991] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.735398] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.735561] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.735715] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port e2ddc440-45ba-4e88-941a-dd8fd21ea4b6 not found, creating... [ 1288.735972] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.736143] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.736261] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.736484] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.736621] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.736967] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.737147] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.737263] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.737543] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.737689] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.737828] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: e2ddc440-45ba-4e88-941a-dd8fd21ea4b6 is going to be created. [ 1288.759115] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.759344] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.759497] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.759791] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.760052] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.760289] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-e2ddc440-45ba-4e88-941a-dd8fd21ea4b6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.927608] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.430308] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.430553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.430553] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.430961] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.430961] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.430961] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e01a5513-045d-4e42-a158-09a37391b50b is going to be updated. [ 1289.469536] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.469768] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.469768] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.469983] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.470159] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.479881] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e01a5513-045d-4e42-a158-09a37391b50b in Status: IN_PROGRESS for 2s [ 1290.319039] env[66994]: INFO networking_nsxv3.common.synchronization [req-fc2095d0-0dab-4e3c-a5f5-d2518471cb39 req-5b76562b-c172-4704-bf89-355ec5250a91 service nova] Enqueued Resource ID: e01a5513-045d-4e42-a158-09a37391b50b with Priority: HIGHEST for action security_group_rules [ 1290.319039] env[66994]: INFO networking_nsxv3.common.synchronization [req-fc2095d0-0dab-4e3c-a5f5-d2518471cb39 req-5b76562b-c172-4704-bf89-355ec5250a91 service nova] Enqueued Resource ID: e01a5513-045d-4e42-a158-09a37391b50b with Priority: HIGHEST for action security_group_members [ 1290.319039] env[66994]: INFO networking_nsxv3.common.synchronization [req-fc2095d0-0dab-4e3c-a5f5-d2518471cb39 req-5b76562b-c172-4704-bf89-355ec5250a91 service nova] Enqueued Resource ID: e2ddc440-45ba-4e88-941a-dd8fd21ea4b6 with Priority: HIGHEST for action port [ 1290.319729] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e01a5513-045d-4e42-a158-09a37391b50b with Priority: HIGHEST for action security_group_rules [ 1290.319966] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e01a5513-045d-4e42-a158-09a37391b50b with Priority: HIGHEST for action security_group_members [ 1290.321149] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2ddc440-45ba-4e88-941a-dd8fd21ea4b6 with Priority: HIGHEST for action port [ 1290.321149] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e01a5513-045d-4e42-a158-09a37391b50b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.321149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.321149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.321149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.321149] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.322012] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e01a5513-045d-4e42-a158-09a37391b50b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.322117] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.322325] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2ddc440-45ba-4e88-941a-dd8fd21ea4b6 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.322421] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2ddc440-45ba-4e88-941a-dd8fd21ea4b6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.322650] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2ddc440-45ba-4e88-941a-dd8fd21ea4b6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.322650] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2ddc440-45ba-4e88-941a-dd8fd21ea4b6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.322748] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2ddc440-45ba-4e88-941a-dd8fd21ea4b6',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.824410] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e01a5513-045d-4e42-a158-09a37391b50b taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.824626] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.824737] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2ddc440-45ba-4e88-941a-dd8fd21ea4b6 with status ACTIVE [ 1290.824915] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.825035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.825106] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.825328] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.825422] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.825602] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.825701] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.825765] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.825926] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.826015] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.826214] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.826309] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.826373] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.826516] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.826595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.826680] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2ddc440-45ba-4e88-941a-dd8fd21ea4b6 is going to be updated. [ 1290.848913] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.849148] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.849148] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.849321] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.849456] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.849650] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2ddc440-45ba-4e88-941a-dd8fd21ea4b6" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.489685] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e01a5513-045d-4e42-a158-09a37391b50b in Status: SUCCESS [ 1291.490074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.490177] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.490354] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.490585] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.490742] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.490814] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.491012] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.491104] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.491222] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.992984] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.495104] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.998235] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.998503] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.998596] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.998960] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.999122] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.999250] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e01a5513-045d-4e42-a158-09a37391b50b is going to be updated. [ 1293.041262] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.041530] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.041530] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.041738] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.041795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.051286] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e01a5513-045d-4e42-a158-09a37391b50b in Status: IN_PROGRESS for 2s [ 1295.063677] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e01a5513-045d-4e42-a158-09a37391b50b in Status: SUCCESS [ 1295.064156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.064156] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.064290] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.064480] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.064599] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.064653] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.064805] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.064890] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.064975] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.065078] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.321429] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1295.321595] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1295.567281] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e01a5513-045d-4e42-a158-09a37391b50b taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.567497] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.567497] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.567872] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.567872] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.568088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.568088] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.568243] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.568304] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.568378] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.568526] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e01a5513-045d-4e42-a158-09a37391b50b taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.568616] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.568673] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.568818] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.568956] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.569054] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.569108] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.569262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.569317] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.569380] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.569466] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.921973] env[66994]: INFO networking_nsxv3.common.synchronization [req-80ef3f84-f7eb-4504-8834-a1b0d0743092 req-c146049e-75de-4499-b133-572de0073b0c tempest-AttachInterfacesTestJSON-1437683655 tempest-AttachInterfacesTestJSON-1437683655-project-member] Enqueued Resource ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 with Priority: HIGHEST for action security_group_members [ 1295.922369] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 with Priority: HIGHEST for action security_group_members [ 1295.922744] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-18b42095-7bb8-4ea4-a397-e90957ef9f27 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.922904] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.922988] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.923255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.923450] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.923571] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.923684] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.923881] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.924016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.924130] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.073388] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e01a5513-045d-4e42-a158-09a37391b50b: rpc.has_security_group_logging(os_id): False [ 1296.097466] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.097722] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.097722] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.097944] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.098082] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.098334] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.098451] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.098519] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.098711] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.098821] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.099071] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.099180] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.099265] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.099417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.099511] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.099804] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.099930] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.099930] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.100299] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.100387] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.100496] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e01a5513-045d-4e42-a158-09a37391b50b is going to be updated. [ 1296.171729] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.171973] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.172113] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.172415] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.172647] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.191214] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e01a5513-045d-4e42-a158-09a37391b50b in Status: IN_PROGRESS for 2s [ 1296.427270] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.930104] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.433574] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.433574] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.433574] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.433574] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.433574] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.434057] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 is going to be updated. [ 1297.463878] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.464085] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.464180] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.464391] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.464584] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.475247] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 in Status: IN_PROGRESS for 2s [ 1298.205298] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e01a5513-045d-4e42-a158-09a37391b50b in Status: SUCCESS [ 1298.205600] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.486202] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 in Status: SUCCESS [ 1299.486632] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.923378] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1300.923594] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1302.300331] env[66994]: INFO networking_nsxv3.common.synchronization [req-20c1eb34-eee2-40f1-8123-8f942a25c084 req-10520f42-f061-4c0b-b3a6-049635c4c130 tempest-AttachInterfacesTestJSON-1437683655 tempest-AttachInterfacesTestJSON-1437683655-project-member] Enqueued Resource ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 with Priority: HIGHEST for action security_group_members [ 1302.300848] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 with Priority: HIGHEST for action security_group_members [ 1302.301245] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-18b42095-7bb8-4ea4-a397-e90957ef9f27 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.301348] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.301348] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.301520] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.301672] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.301765] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.301821] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.301957] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.302048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.302139] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.804474] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.804695] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.804766] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.804981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.831617] env[66994]: INFO networking_nsxv3.common.synchronization [req-1c53863a-32ed-4820-9756-aa935d5271c5 req-b6679ee8-a8de-40ee-8fd4-307a3c1fb5bb tempest-ServersNegativeTestJSON-1687938332 tempest-ServersNegativeTestJSON-1687938332-project-member] Enqueued Resource ID: e01a5513-045d-4e42-a158-09a37391b50b with Priority: HIGHEST for action security_group_members [ 1302.831962] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.832388] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.832752] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.832973] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.833337] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.833548] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.833767] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 is going to be updated. [ 1302.835196] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e01a5513-045d-4e42-a158-09a37391b50b with Priority: HIGHEST for action security_group_members [ 1302.835936] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e01a5513-045d-4e42-a158-09a37391b50b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.836229] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.836438] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.836721] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.837045] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.837320] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.837511] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.837776] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.837976] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.838205] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.868314] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.868462] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.868548] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.868745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.868912] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.878665] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 in Status: IN_PROGRESS for 2s [ 1303.342904] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.845180] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.348042] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.348391] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.348391] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.348551] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.348653] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.348762] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e01a5513-045d-4e42-a158-09a37391b50b is going to be updated. [ 1304.376774] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.376959] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.377041] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.377259] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.377408] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.386718] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e01a5513-045d-4e42-a158-09a37391b50b in Status: IN_PROGRESS for 2s [ 1304.888972] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 in Status: SUCCESS [ 1304.888972] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 deletion is rescheduled due to dependency. [ 1304.889301] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.397371] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e01a5513-045d-4e42-a158-09a37391b50b in Status: SUCCESS [ 1306.397786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.753506] env[66994]: INFO networking_nsxv3.common.synchronization [None req-20c549db-6a91-414b-94e8-4c85669cc143 tempest-AttachInterfacesTestJSON-1437683655 tempest-AttachInterfacesTestJSON-1437683655-project-member] Enqueued Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1306.754101] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b740b91b-8f03-45e7-909b-66803d9ffafa with Priority: HIGHEST for action security_group_members [ 1306.755154] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-b740b91b-8f03-45e7-909b-66803d9ffafa taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.755303] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.755386] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.755661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.755789] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.755913] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.755981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.756177] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.756267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.756380] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b740b91b-8f03-45e7-909b-66803d9ffafa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.258673] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.258847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.258897] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.259251] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.259355] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.259542] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.259657] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.261026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.261026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.261026] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.261026] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa is going to be updated. [ 1307.291059] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.291262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.291262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.291424] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.291559] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.301403] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: IN_PROGRESS for 2s [ 1309.313218] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b740b91b-8f03-45e7-909b-66803d9ffafa in Status: SUCCESS [ 1309.313535] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b740b91b-8f03-45e7-909b-66803d9ffafa deletion is rescheduled due to dependency. [ 1309.313535] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b740b91b-8f03-45e7-909b-66803d9ffafa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.756753] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1311.756753] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1312.613583] env[66994]: INFO networking_nsxv3.common.synchronization [req-b532586c-f798-4b72-ad54-ae78fd95f3c2 req-9c175847-62a7-4504-9655-0eeda47af50e tempest-ServerActionsTestOtherA-355769928 tempest-ServerActionsTestOtherA-355769928-project-member] Enqueued Resource ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 with Priority: HIGHEST for action security_group_members [ 1312.613583] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 with Priority: HIGHEST for action security_group_members [ 1312.613583] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.616968] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.616968] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.616968] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.616968] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.616968] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.616968] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.616968] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.616968] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.616968] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.121141] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.623403] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.128895] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.128895] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.128895] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.128895] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.128895] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.128895] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 is going to be updated. [ 1314.159494] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.159494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.159494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.159494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.159494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.167385] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 in Status: IN_PROGRESS for 2s [ 1316.178999] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 in Status: SUCCESS [ 1316.179341] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.613729] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1317.614114] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1322.615445] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1322.615816] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1327.616165] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1327.616650] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1330.261753] env[66994]: INFO networking_nsxv3.common.synchronization [req-671a25aa-7c25-454a-9069-6c773cd077ee req-3505e41e-15d0-4609-8f8c-85c9a5a12ff5 tempest-ServerActionsTestOtherA-355769928 tempest-ServerActionsTestOtherA-355769928-project-member] Enqueued Resource ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 with Priority: HIGHEST for action security_group_members [ 1330.262416] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 with Priority: HIGHEST for action security_group_members [ 1330.262729] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.262857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.262925] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.263153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.263316] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.263515] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.263597] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.263760] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.263848] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.263946] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.767406] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.767633] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.767633] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.767862] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.789228] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.789493] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.789636] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.789704] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.789922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.790021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.790116] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 is going to be updated. [ 1330.815796] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.815994] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.816081] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.816292] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.816494] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.825958] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 in Status: IN_PROGRESS for 2s [ 1332.341434] env[66994]: INFO networking_nsxv3.common.synchronization [req-f7289460-1c08-411d-8b97-287da0935556 req-04fe6555-1701-4988-bf40-db2f273aa098 tempest-ServerActionsTestJSON-501116813 tempest-ServerActionsTestJSON-501116813-project-member] Enqueued Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_members [ 1332.341619] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_members [ 1332.341905] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a75cae-9123-4d4d-9e51-add1196ab1f2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.342674] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.342674] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.342674] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.342674] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.342674] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.342674] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.342958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.342958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.343045] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.836862] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 in Status: SUCCESS [ 1332.837048] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 deletion is rescheduled due to dependency. [ 1332.837172] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.844715] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.844851] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.844938] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.845170] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.845242] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.845421] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.845519] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.845576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.845732] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.845828] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.845915] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 is going to be updated. [ 1332.884025] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.884025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.884025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.884025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.884025] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.904167] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: IN_PROGRESS for 2s [ 1334.916089] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: SUCCESS [ 1334.916089] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 deletion is rescheduled due to dependency. [ 1334.916089] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.342881] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1337.343241] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1339.363954] env[66994]: INFO networking_nsxv3.common.synchronization [req-e3e71d4e-9fa9-4035-ae64-42f9629f4753 req-db384a49-087d-4ff7-9af4-ea35760114c8 tempest-ServerActionsTestJSON-501116813 tempest-ServerActionsTestJSON-501116813-project-member] Enqueued Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_members [ 1339.364521] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_members [ 1339.365579] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a75cae-9123-4d4d-9e51-add1196ab1f2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.365579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.365579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.365579] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.365759] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.365806] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.365869] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.366054] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.366152] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.366257] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.655657] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-736 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.655807] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-736" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.655893] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-736" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.656250] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-736" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.656566] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.656757] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.656900] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.657176] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.657383] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.657645] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1339.657759] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1339.657869] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1339.657981] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1339.658102] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1339.658208] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1339.658340] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1339.679550] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1339.679705] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1339.679853] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1339.680051] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-736" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.680373] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-36148e8a-991c-4a5e-bfbc-4b2513d764fa taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.680542] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-36148e8a-991c-4a5e-bfbc-4b2513d764fa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.680676] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-36148e8a-991c-4a5e-bfbc-4b2513d764fa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.681010] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-36148e8a-991c-4a5e-bfbc-4b2513d764fa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.681202] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36148e8a-991c-4a5e-bfbc-4b2513d764fa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.869027] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.869306] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.869306] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.869452] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.869526] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.869680] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.869786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.869839] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.869981] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.870102] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.870197] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 is going to be updated. [ 1339.896102] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.896291] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.896363] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.896508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.896661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.905109] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: IN_PROGRESS for 2s [ 1340.184108] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.184294] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.184435] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.184715] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.185134] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.185134] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 36148e8a-991c-4a5e-bfbc-4b2513d764fa not found, creating... [ 1340.185367] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.185601] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.185760] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.186073] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.186281] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.186620] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.186786] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.186905] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.187178] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.187316] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.187458] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 36148e8a-991c-4a5e-bfbc-4b2513d764fa is going to be created. [ 1340.210990] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.211316] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.211475] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.211749] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.211973] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.212211] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-36148e8a-991c-4a5e-bfbc-4b2513d764fa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.879250] env[66994]: INFO networking_nsxv3.common.synchronization [req-e3e71d4e-9fa9-4035-ae64-42f9629f4753 req-48bb7651-206e-40ba-9ac7-28e0e331c3df service nova] Enqueued Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_rules [ 1340.879905] env[66994]: INFO networking_nsxv3.common.synchronization [req-e3e71d4e-9fa9-4035-ae64-42f9629f4753 req-48bb7651-206e-40ba-9ac7-28e0e331c3df service nova] Enqueued Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_members [ 1340.879905] env[66994]: INFO networking_nsxv3.common.synchronization [req-e3e71d4e-9fa9-4035-ae64-42f9629f4753 req-48bb7651-206e-40ba-9ac7-28e0e331c3df service nova] Enqueued Resource ID: 36148e8a-991c-4a5e-bfbc-4b2513d764fa with Priority: HIGHEST for action port [ 1340.880084] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_rules [ 1340.880207] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_members [ 1340.880297] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36148e8a-991c-4a5e-bfbc-4b2513d764fa with Priority: HIGHEST for action port [ 1340.880567] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88a75cae-9123-4d4d-9e51-add1196ab1f2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.880685] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.880783] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.880939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.881116] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.882477] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a75cae-9123-4d4d-9e51-add1196ab1f2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.882477] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.882477] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-36148e8a-991c-4a5e-bfbc-4b2513d764fa taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.882477] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36148e8a-991c-4a5e-bfbc-4b2513d764fa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.883054] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36148e8a-991c-4a5e-bfbc-4b2513d764fa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.884019] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36148e8a-991c-4a5e-bfbc-4b2513d764fa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.884019] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36148e8a-991c-4a5e-bfbc-4b2513d764fa',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.386119] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a75cae-9123-4d4d-9e51-add1196ab1f2 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.386119] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.386119] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36148e8a-991c-4a5e-bfbc-4b2513d764fa with status ACTIVE [ 1341.386344] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.386408] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.386440] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.386699] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.386699] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.386862] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.386956] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.387021] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.387186] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.387258] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.387435] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.387523] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.387580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.387714] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.387786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.387866] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36148e8a-991c-4a5e-bfbc-4b2513d764fa is going to be updated. [ 1341.408689] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.408889] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.408889] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.409262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.409262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.409412] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36148e8a-991c-4a5e-bfbc-4b2513d764fa" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.914540] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: SUCCESS [ 1341.914887] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 deletion is rescheduled due to dependency. [ 1341.914887] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.914983] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.915211] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.915392] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.915516] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.915582] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.915735] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.915816] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.915907] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.418215] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.920894] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.423913] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.424078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.424078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.424268] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.424357] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.424454] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 is going to be updated. [ 1343.449751] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.449910] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.449954] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.450211] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.450347] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.459535] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: IN_PROGRESS for 2s [ 1345.470670] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: SUCCESS [ 1345.471072] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.471072] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.471268] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.471463] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.471585] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.471692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.471791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.471869] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.471953] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.472055] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.620218] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock network-132 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.620440] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "network-132" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.620564] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "network-132" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.620836] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "network-132" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.621258] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.621437] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.621556] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.621777] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.621921] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.622148] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1345.622260] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1345.622368] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1345.622495] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1345.622609] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1345.622710] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1345.622840] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1345.643047] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1345.643047] env[66994]: DEBUG dogpile.cache.region [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1345.643047] env[66994]: DEBUG dogpile.lock [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1345.643047] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "network-132" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.643253] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock port-c6e2293a-4e6c-46e8-a146-231b4ef957a9 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.643334] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "port-c6e2293a-4e6c-46e8-a146-231b4ef957a9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.643425] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "port-c6e2293a-4e6c-46e8-a146-231b4ef957a9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.643638] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "port-c6e2293a-4e6c-46e8-a146-231b4ef957a9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.643783] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6e2293a-4e6c-46e8-a146-231b4ef957a9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.881415] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.881615] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1345.974248] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.146861] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.147126] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.147212] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.147496] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.147643] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.147956] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.148195] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.148326] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.148549] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.148687] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.148968] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.149138] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.149253] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.149456] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.149584] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.149724] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Resource: SegmentPort with ID: c6e2293a-4e6c-46e8-a146-231b4ef957a9 is going to be updated. [ 1346.173162] env[66994]: DEBUG networking_nsxv3.common.locking [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.173388] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.173490] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.173761] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.173957] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.174200] env[66994]: DEBUG oslo_concurrency.lockutils [None req-cf3b31b1-a76c-4230-b9fd-0aa71bac39d9 None None] Releasing lock "port-c6e2293a-4e6c-46e8-a146-231b4ef957a9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.476148] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88a75cae-9123-4d4d-9e51-add1196ab1f2: rpc.has_security_group_logging(os_id): False [ 1346.494566] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.494782] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.494782] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.494979] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.495086] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.495349] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.495465] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.495530] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.495689] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.495764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.495852] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 is going to be updated. [ 1346.554962] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.555197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.555245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.555435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.555583] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.568139] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: IN_PROGRESS for 2s [ 1346.853290] env[66994]: INFO networking_nsxv3.common.synchronization [req-7949292d-f059-4f55-8515-b85f7d4df016 req-6d44d9b6-7eb9-4ef0-a5ce-5cd58182f39d service nova] Enqueued Resource ID: e01a5513-045d-4e42-a158-09a37391b50b with Priority: HIGHEST for action security_group_rules [ 1346.853290] env[66994]: INFO networking_nsxv3.common.synchronization [req-7949292d-f059-4f55-8515-b85f7d4df016 req-6d44d9b6-7eb9-4ef0-a5ce-5cd58182f39d service nova] Enqueued Resource ID: e01a5513-045d-4e42-a158-09a37391b50b with Priority: HIGHEST for action security_group_members [ 1346.853290] env[66994]: INFO networking_nsxv3.common.synchronization [req-7949292d-f059-4f55-8515-b85f7d4df016 req-6d44d9b6-7eb9-4ef0-a5ce-5cd58182f39d service nova] Enqueued Resource ID: c6e2293a-4e6c-46e8-a146-231b4ef957a9 with Priority: HIGHEST for action port [ 1346.853290] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e01a5513-045d-4e42-a158-09a37391b50b with Priority: HIGHEST for action security_group_rules [ 1346.853290] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e01a5513-045d-4e42-a158-09a37391b50b with Priority: HIGHEST for action security_group_members [ 1346.853290] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6e2293a-4e6c-46e8-a146-231b4ef957a9 with Priority: HIGHEST for action port [ 1346.853290] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e01a5513-045d-4e42-a158-09a37391b50b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.854022] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.854245] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.854661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.854878] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.855965] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e01a5513-045d-4e42-a158-09a37391b50b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.856136] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.856230] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.856489] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.856771] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.856771] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.856995] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.857441] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.857592] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.857726] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.858566] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6e2293a-4e6c-46e8-a146-231b4ef957a9 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.858730] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6e2293a-4e6c-46e8-a146-231b4ef957a9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.858826] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6e2293a-4e6c-46e8-a146-231b4ef957a9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.859080] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6e2293a-4e6c-46e8-a146-231b4ef957a9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.859242] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6e2293a-4e6c-46e8-a146-231b4ef957a9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.362414] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e01a5513-045d-4e42-a158-09a37391b50b taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.362414] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.362873] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.363563] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6e2293a-4e6c-46e8-a146-231b4ef957a9 with status ACTIVE [ 1347.364379] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.364379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.364379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.364379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.364379] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.364379] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.364838] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.364838] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.364838] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.364838] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.365095] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.365095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.365095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.365308] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.365308] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.365308] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6e2293a-4e6c-46e8-a146-231b4ef957a9 is going to be updated. [ 1347.389827] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.390247] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.390247] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.390420] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.390475] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.390612] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6e2293a-4e6c-46e8-a146-231b4ef957a9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.867831] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.370293] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.370532] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.370666] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.370972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.371145] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.371307] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e01a5513-045d-4e42-a158-09a37391b50b is going to be updated. [ 1348.404971] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.405211] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.405262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.405500] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.405648] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.417069] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e01a5513-045d-4e42-a158-09a37391b50b in Status: IN_PROGRESS for 2s [ 1348.582741] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: SUCCESS [ 1348.582958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.427680] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e01a5513-045d-4e42-a158-09a37391b50b in Status: SUCCESS [ 1350.428089] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.428089] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.428320] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.428561] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.428692] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.428752] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.428923] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.429011] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.429182] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.429230] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.932078] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e01a5513-045d-4e42-a158-09a37391b50b taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.932295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.932295] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.932508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.932690] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.932795] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.932860] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.933031] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.933111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.933200] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.933342] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e01a5513-045d-4e42-a158-09a37391b50b taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.933432] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.933490] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.933627] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.933759] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.933847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.933907] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.934052] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.934158] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.934211] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.934295] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.436723] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e01a5513-045d-4e42-a158-09a37391b50b: rpc.has_security_group_logging(os_id): False [ 1351.455675] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.456086] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.456086] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.456201] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.456238] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.456429] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.456517] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.456589] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.456726] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.456868] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.457008] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.457111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.457171] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.457294] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.457365] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.457547] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.457653] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.457715] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.457877] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.457949] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.458064] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e01a5513-045d-4e42-a158-09a37391b50b is going to be updated. [ 1351.524673] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.524799] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.524859] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.525087] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.525238] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.543850] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e01a5513-045d-4e42-a158-09a37391b50b in Status: IN_PROGRESS for 2s [ 1351.853628] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1351.853810] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1353.559610] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e01a5513-045d-4e42-a158-09a37391b50b in Status: SUCCESS [ 1353.560063] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.854978] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1356.854978] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1361.856483] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1361.856902] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1366.858072] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1366.858428] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1371.860092] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1371.860470] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1373.981458] env[66994]: INFO networking_nsxv3.common.synchronization [req-0c2a78e5-16f5-4fca-9d52-a4ea892a46c3 req-851ffd52-9094-43e6-beb2-25be48d50421 tempest-ServersNegativeTestJSON-1687938332 tempest-ServersNegativeTestJSON-1687938332-project-member] Enqueued Resource ID: e01a5513-045d-4e42-a158-09a37391b50b with Priority: HIGHEST for action security_group_members [ 1373.981870] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e01a5513-045d-4e42-a158-09a37391b50b with Priority: HIGHEST for action security_group_members [ 1373.982196] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-e01a5513-045d-4e42-a158-09a37391b50b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.982322] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.982383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.982968] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.982968] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.982968] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.982968] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.983216] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.983216] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.983216] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e01a5513-045d-4e42-a158-09a37391b50b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.485291] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.485452] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.485523] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.485756] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.485851] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.486050] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.486152] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.486210] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.486355] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.486432] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.486544] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e01a5513-045d-4e42-a158-09a37391b50b is going to be updated. [ 1374.516253] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.516444] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.516486] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.516664] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.516804] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.526584] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e01a5513-045d-4e42-a158-09a37391b50b in Status: IN_PROGRESS for 2s [ 1376.537529] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e01a5513-045d-4e42-a158-09a37391b50b in Status: SUCCESS [ 1376.537901] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e01a5513-045d-4e42-a158-09a37391b50b deletion is rescheduled due to dependency. [ 1376.537901] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e01a5513-045d-4e42-a158-09a37391b50b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.983008] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1378.983304] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1383.983848] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1383.984257] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1388.985091] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1388.985486] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1393.986399] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1393.986759] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1398.987480] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1398.987928] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1399.808914] env[66994]: INFO networking_nsxv3.common.synchronization [req-55f17ba3-4ae2-40b0-92e5-077e0b56b28c req-130ed93f-4c01-4e51-a7de-14dfeb938053 tempest-ServerActionsTestJSON-501116813 tempest-ServerActionsTestJSON-501116813-project-member] Enqueued Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_members [ 1399.809465] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGHEST for action security_group_members [ 1399.809772] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-88a75cae-9123-4d4d-9e51-add1196ab1f2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.809902] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.809971] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.810193] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.810347] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.810477] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.810831] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.810831] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.810831] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.811053] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.312971] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.313391] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.313391] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.313391] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.313498] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.313786] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.313915] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.314034] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.314253] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.314358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.314472] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 is going to be updated. [ 1400.346698] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.346936] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.346936] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.347265] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.347441] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.356018] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: IN_PROGRESS for 2s [ 1402.370543] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 in Status: SUCCESS [ 1402.370972] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 deletion is rescheduled due to dependency. [ 1402.370972] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.810322] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1404.810652] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1407.666228] env[66994]: INFO networking_nsxv3.common.synchronization [None req-8df32a33-fe75-42c6-9556-1f32186698d5 None None] Enqueued Resource ID: 450982bf-4813-40e3-980e-781249bfb191 with Priority: HIGHEST for action port [ 1407.667146] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 450982bf-4813-40e3-980e-781249bfb191 with Priority: HIGHEST for action port [ 1407.667146] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-450982bf-4813-40e3-980e-781249bfb191 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.667146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-450982bf-4813-40e3-980e-781249bfb191" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.667146] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-450982bf-4813-40e3-980e-781249bfb191" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.671137] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-450982bf-4813-40e3-980e-781249bfb191" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.671992] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('450982bf-4813-40e3-980e-781249bfb191',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.175065] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 450982bf-4813-40e3-980e-781249bfb191 [ 1408.175780] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.175780] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.175780] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.175780] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.175780] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.176174] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:450982bf-4813-40e3-980e-781249bfb191 already deleted. [ 1408.176174] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-450982bf-4813-40e3-980e-781249bfb191" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.270014] env[66994]: INFO networking_nsxv3.common.synchronization [None req-318ad723-8e04-41ec-aaa7-255d245f6fc0 tempest-AttachVolumeTestJSON-954084012 tempest-AttachVolumeTestJSON-954084012-project-member] Enqueued Resource ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 with Priority: HIGHEST for action security_group_rules [ 1408.270602] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 with Priority: HIGHEST for action security_group_rules [ 1408.271075] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.271215] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.271285] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.271539] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.271628] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f220ab4-28c5-4bb5-8455-bdaa6e463ad4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.355124] env[66994]: INFO networking_nsxv3.common.synchronization [None req-18de5552-06d3-46be-94af-0b67601d5476 tempest-AttachVolumeTestJSON-954084012 tempest-AttachVolumeTestJSON-954084012-project-member] Enqueued Resource ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 with Priority: HIGHEST for action security_group_rules [ 1408.355618] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 with Priority: HIGHEST for action security_group_rules [ 1408.355924] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.356035] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.795069] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.795376] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.795376] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.795516] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.795606] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.795702] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 already deleted. [ 1408.795786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.795935] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.796106] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.796190] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f220ab4-28c5-4bb5-8455-bdaa6e463ad4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.316709] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.316709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.316709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.316709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.316709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.316709] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 already deleted. [ 1409.316709] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.825448] env[66994]: INFO networking_nsxv3.common.synchronization [None req-a53e5377-272e-444b-b318-3275695eade6 None None] Enqueued Resource ID: ec87c8bb-c9c8-43e4-b10a-c8c824c2b3ce with Priority: HIGHEST for action port [ 1409.826488] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec87c8bb-c9c8-43e4-b10a-c8c824c2b3ce with Priority: HIGHEST for action port [ 1409.826488] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec87c8bb-c9c8-43e4-b10a-c8c824c2b3ce taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.826488] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec87c8bb-c9c8-43e4-b10a-c8c824c2b3ce" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.826488] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec87c8bb-c9c8-43e4-b10a-c8c824c2b3ce" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.826741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec87c8bb-c9c8-43e4-b10a-c8c824c2b3ce" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.826825] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec87c8bb-c9c8-43e4-b10a-c8c824c2b3ce',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.329428] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec87c8bb-c9c8-43e4-b10a-c8c824c2b3ce [ 1410.329683] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.329814] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.329882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.330116] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.330209] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.330312] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec87c8bb-c9c8-43e4-b10a-c8c824c2b3ce already deleted. [ 1410.330421] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec87c8bb-c9c8-43e4-b10a-c8c824c2b3ce" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.721107] env[66994]: INFO networking_nsxv3.common.synchronization [req-7b340ae9-64a0-44a2-b10b-1dddfeba603b req-9bb5435f-a82e-425d-8ff4-370632dd7f99 tempest-AttachVolumeTestJSON-954084012 tempest-AttachVolumeTestJSON-954084012-project-member] Enqueued Resource ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 with Priority: HIGHEST for action security_group_members [ 1413.721675] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 with Priority: HIGHEST for action security_group_members [ 1413.722011] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.722135] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.722206] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.722467] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.722636] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.722754] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.722820] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.723010] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.723095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.723205] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f220ab4-28c5-4bb5-8455-bdaa6e463ad4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.990259] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.990442] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-442" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.990566] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-442" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.990880] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-442" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.991151] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.991312] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.991427] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.991644] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.991842] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.992060] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1413.992178] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1413.992288] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1413.992395] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1413.992504] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1413.992609] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1413.992761] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1414.016560] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1414.016815] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1414.016966] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1414.017155] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-442" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.017446] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-1f687e10-5881-4bd8-9caf-3167a453cbae taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.017619] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-1f687e10-5881-4bd8-9caf-3167a453cbae" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.017741] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-1f687e10-5881-4bd8-9caf-3167a453cbae" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.018056] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-1f687e10-5881-4bd8-9caf-3167a453cbae" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.018193] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f687e10-5881-4bd8-9caf-3167a453cbae',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.225872] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.226149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.226149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.226267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.226362] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.226565] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.226659] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.226727] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.226866] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.226987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.227063] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 already deleted. [ 1414.227111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.521067] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.521067] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.521274] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.521372] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.521509] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.521664] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 1f687e10-5881-4bd8-9caf-3167a453cbae not found, creating... [ 1414.522071] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.522207] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.522341] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.522500] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.522637] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.522953] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.523123] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.523237] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.523441] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.523570] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.523708] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 1f687e10-5881-4bd8-9caf-3167a453cbae is going to be created. [ 1414.545310] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.545522] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.545657] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.545874] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.546115] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.546330] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-1f687e10-5881-4bd8-9caf-3167a453cbae" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.224692] env[66994]: INFO networking_nsxv3.common.synchronization [req-7b340ae9-64a0-44a2-b10b-1dddfeba603b req-eeb383c0-25de-4020-bb5e-24fe46113f5e service nova] Enqueued Resource ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 with Priority: HIGHEST for action security_group_rules [ 1415.224950] env[66994]: INFO networking_nsxv3.common.synchronization [req-7b340ae9-64a0-44a2-b10b-1dddfeba603b req-eeb383c0-25de-4020-bb5e-24fe46113f5e service nova] Enqueued Resource ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 with Priority: HIGHEST for action security_group_members [ 1415.225008] env[66994]: INFO networking_nsxv3.common.synchronization [req-7b340ae9-64a0-44a2-b10b-1dddfeba603b req-eeb383c0-25de-4020-bb5e-24fe46113f5e service nova] Enqueued Resource ID: 1f687e10-5881-4bd8-9caf-3167a453cbae with Priority: HIGHEST for action port [ 1415.225234] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 with Priority: HIGHEST for action security_group_rules [ 1415.225361] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 with Priority: HIGHEST for action security_group_members [ 1415.225454] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f687e10-5881-4bd8-9caf-3167a453cbae with Priority: HIGHEST for action port [ 1415.225984] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.226153] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.226192] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.226375] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.226474] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f220ab4-28c5-4bb5-8455-bdaa6e463ad4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.227246] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.227362] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.227431] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.227594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.227766] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.227832] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.227895] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.228111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.228194] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.228278] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f220ab4-28c5-4bb5-8455-bdaa6e463ad4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.229054] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f687e10-5881-4bd8-9caf-3167a453cbae taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.229711] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f687e10-5881-4bd8-9caf-3167a453cbae" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.230067] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f687e10-5881-4bd8-9caf-3167a453cbae" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.230067] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f687e10-5881-4bd8-9caf-3167a453cbae" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.230144] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f687e10-5881-4bd8-9caf-3167a453cbae',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.732696] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f687e10-5881-4bd8-9caf-3167a453cbae with status ACTIVE [ 1415.732870] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.733073] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.733073] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.733308] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.733400] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.733580] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.733684] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.733747] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.733898] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.733978] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.734176] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.734275] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.734318] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.734455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.734525] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.734608] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f687e10-5881-4bd8-9caf-3167a453cbae is going to be updated. [ 1415.735838] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.735930] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.736585] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f220ab4-28c5-4bb5-8455-bdaa6e463ad4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.758238] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.758465] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.758465] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.758661] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.758810] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.758959] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f687e10-5881-4bd8-9caf-3167a453cbae" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.238785] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f220ab4-28c5-4bb5-8455-bdaa6e463ad4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1416.741877] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.742112] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.742112] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.742276] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.742372] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.742472] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 is going to be created. [ 1416.768451] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.768639] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.768691] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.768883] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.769048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.778995] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 in Status: UNINITIALIZED for 2s [ 1418.791498] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 in Status: SUCCESS [ 1418.791873] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.791873] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.792111] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.792302] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.792418] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.792480] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.792639] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.792717] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.792816] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.792909] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f220ab4-28c5-4bb5-8455-bdaa6e463ad4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.295047] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f220ab4-28c5-4bb5-8455-bdaa6e463ad4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.797888] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4: rpc.has_security_group_logging(os_id): False [ 1419.815516] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.815729] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.815729] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.815933] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.816058] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.816313] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.816417] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.816479] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.816642] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.816720] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.816806] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 is going to be created. [ 1419.873977] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.874198] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.874198] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.874370] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.874546] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.885276] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 in Status: IN_PROGRESS for 2s [ 1420.226931] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1420.227146] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1421.898775] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 in Status: SUCCESS [ 1421.898775] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.227847] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1425.228222] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.229097] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1430.229514] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1435.230378] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1435.230740] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1440.231584] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1440.231584] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1445.232760] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1445.233166] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1450.233933] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1450.233933] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1455.235397] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1455.235397] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1460.236280] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1460.236707] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1465.236879] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1465.237282] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1470.238340] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1470.238740] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1475.239399] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1475.239800] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1480.240955] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1480.241547] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1485.241707] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1485.242106] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1486.206281] env[66994]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1486.206517] env[66994]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee241852-a152-4b00-80da-5d1a463015b3 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1490.243308] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1490.243736] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1495.244572] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1495.244927] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1500.245746] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1500.246264] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1502.145640] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1502.146115] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1502.146115] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1502.146222] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1502.146254] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1502.648891] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.151619] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1503.654145] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1503.654356] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1504.426443] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.426873] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.426873] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.426873] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.438427] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1504.440832] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.441636] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1504.482279] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.482495] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.482594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.482845] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.496976] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.497725] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1504.497809] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1504.497900] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1504.529739] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.529939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.529939] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.530150] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.530853] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.530996] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1504.604694] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.604915] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.604915] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.605078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.605375] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.605649] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1504.679798] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.680064] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.680064] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.680212] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.680507] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.680788] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:25. [ 1504.680893] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'88a75cae-9123-4d4d-9e51-add1196ab1f2', 'de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8', '705505ff-4cd1-493a-b249-a5178fb4ee23', 'a6612b52-6412-47ab-8918-14b6b8bca0cb', 'a66f6cb4-94dc-4701-ac62-f6c6e4d4e305', '8ffb70f8-4012-40ec-b9e7-bc37e90e6e70', '5f220ab4-28c5-4bb5-8455-bdaa6e463ad4', '7fc519de-4252-44ff-ace7-b0a5f3000ccf', '2f159d71-0083-4a40-882f-2a28e3868c96', '44494650-6b02-4361-a53d-fb11ecaa53f2', 'd88934f6-85c4-4f45-a1fc-042377e3901a', '01dce4c1-af3a-4e00-a26c-16f52625131a', '91e3865c-9322-423a-9d64-5c548ef52da8', '18b42095-7bb8-4ea4-a397-e90957ef9f27', 'd4672e8d-a5ca-46f8-8d7b-adf4da6e472b', '34a807f7-3865-4ec7-9af1-5f447e70423b', '52c814d2-8c46-4f11-a3ab-47d2b96480f7', 'aaddbb4b-3076-42ef-afd8-2dcbedf8773e', '841e623a-3249-4bd3-878a-817068626c8a', '9cde16ce-be95-4b19-a4ea-e24f03fb1476', '086f38af-0633-4270-b4b2-f416d2945ae1', 'e887c3d4-547e-480b-bd4c-f503fcb02ca5', '88bd36a2-b7c7-405c-ba4b-c36eb190f52e', 'e01a5513-045d-4e42-a158-09a37391b50b', 'b740b91b-8f03-45e7-909b-66803d9ffafa'} {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1504.680988] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1504.699231] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.699435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.699435] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.699630] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.699712] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.699822] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1504.699892] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1504.699963] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1504.774186] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.774426] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.774426] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.774593] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.775715] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.775983] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1504.776077] env[66994]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66994) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1504.776153] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1504.776219] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1504.776295] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/25 resources of Type:Security Group Rules [ 1504.776369] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGH for action security_group_rules [ 1504.776447] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGH for action security_group_rules [ 1504.776514] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 with Priority: HIGH for action security_group_rules [ 1504.776577] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a6612b52-6412-47ab-8918-14b6b8bca0cb with Priority: HIGH for action security_group_rules [ 1504.776641] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 with Priority: HIGH for action security_group_rules [ 1504.776702] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 with Priority: HIGH for action security_group_rules [ 1504.776762] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 with Priority: HIGH for action security_group_rules [ 1504.776823] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf with Priority: HIGH for action security_group_rules [ 1504.776883] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2f159d71-0083-4a40-882f-2a28e3868c96 with Priority: HIGH for action security_group_rules [ 1504.776943] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 44494650-6b02-4361-a53d-fb11ecaa53f2 with Priority: HIGH for action security_group_rules [ 1504.777014] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGH for action security_group_rules [ 1504.777077] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 01dce4c1-af3a-4e00-a26c-16f52625131a with Priority: HIGH for action security_group_rules [ 1504.777138] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 91e3865c-9322-423a-9d64-5c548ef52da8 with Priority: HIGH for action security_group_rules [ 1504.777191] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 with Priority: HIGH for action security_group_rules [ 1504.777254] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b with Priority: HIGH for action security_group_rules [ 1504.777314] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 34a807f7-3865-4ec7-9af1-5f447e70423b with Priority: HIGH for action security_group_rules [ 1504.777373] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 with Priority: HIGH for action security_group_rules [ 1504.777434] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e with Priority: HIGH for action security_group_rules [ 1504.777494] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 841e623a-3249-4bd3-878a-817068626c8a with Priority: HIGH for action security_group_rules [ 1504.777555] env[66994]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9cde16ce-be95-4b19-a4ea-e24f03fb1476 with Priority: HIGH for action security_group_rules [ 1504.777647] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.246404] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1505.246605] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1505.246654] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 with Priority: HIGH for action security_group_rules [ 1505.246748] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 with Priority: HIGH for action security_group_rules [ 1505.246852] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 with Priority: HIGH for action security_group_rules [ 1505.246948] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b with Priority: HIGH for action security_group_rules [ 1505.247055] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cde16ce-be95-4b19-a4ea-e24f03fb1476 with Priority: HIGH for action security_group_rules [ 1505.247148] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841e623a-3249-4bd3-878a-817068626c8a with Priority: HIGH for action security_group_rules [ 1505.247237] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e with Priority: HIGH for action security_group_rules [ 1505.247325] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 with Priority: HIGH for action security_group_rules [ 1505.247414] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 with Priority: HIGH for action security_group_rules [ 1505.247503] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a807f7-3865-4ec7-9af1-5f447e70423b with Priority: HIGH for action security_group_rules [ 1505.247593] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91e3865c-9322-423a-9d64-5c548ef52da8 with Priority: HIGH for action security_group_rules [ 1505.247681] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01dce4c1-af3a-4e00-a26c-16f52625131a with Priority: HIGH for action security_group_rules [ 1505.247767] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88934f6-85c4-4f45-a1fc-042377e3901a with Priority: HIGH for action security_group_rules [ 1505.247853] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44494650-6b02-4361-a53d-fb11ecaa53f2 with Priority: HIGH for action security_group_rules [ 1505.247938] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f159d71-0083-4a40-882f-2a28e3868c96 with Priority: HIGH for action security_group_rules [ 1505.248042] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 with Priority: HIGH for action security_group_rules [ 1505.248137] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf with Priority: HIGH for action security_group_rules [ 1505.248222] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 with Priority: HIGH for action security_group_rules [ 1505.248308] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 with Priority: HIGH for action security_group_rules [ 1505.248395] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6612b52-6412-47ab-8918-14b6b8bca0cb with Priority: HIGH for action security_group_rules [ 1505.248735] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88a75cae-9123-4d4d-9e51-add1196ab1f2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.248867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.248935] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.249166] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.249252] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88a75cae-9123-4d4d-9e51-add1196ab1f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.250275] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-705505ff-4cd1-493a-b249-a5178fb4ee23 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.250398] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.250467] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.250658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.250726] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('705505ff-4cd1-493a-b249-a5178fb4ee23',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.251502] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.251629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.251704] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.251863] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.251934] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f220ab4-28c5-4bb5-8455-bdaa6e463ad4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.253088] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.253197] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.253262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.253411] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.253484] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4672e8d-a5ca-46f8-8d7b-adf4da6e472b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.254192] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cde16ce-be95-4b19-a4ea-e24f03fb1476 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.254296] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.254360] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.254594] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.254670] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cde16ce-be95-4b19-a4ea-e24f03fb1476',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.255381] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-841e623a-3249-4bd3-878a-817068626c8a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.255485] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.255585] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.255686] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.255756] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('841e623a-3249-4bd3-878a-817068626c8a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.256437] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aaddbb4b-3076-42ef-afd8-2dcbedf8773e taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.256542] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.256607] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.256753] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.256822] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aaddbb4b-3076-42ef-afd8-2dcbedf8773e',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.257607] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52c814d2-8c46-4f11-a3ab-47d2b96480f7 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.257717] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.257783] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.257932] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.258019] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52c814d2-8c46-4f11-a3ab-47d2b96480f7',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.258680] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18b42095-7bb8-4ea4-a397-e90957ef9f27 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.258788] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.258882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.258993] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.259076] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18b42095-7bb8-4ea4-a397-e90957ef9f27',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.259754] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34a807f7-3865-4ec7-9af1-5f447e70423b taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.259864] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.259930] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.260094] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.260167] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34a807f7-3865-4ec7-9af1-5f447e70423b',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.260929] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91e3865c-9322-423a-9d64-5c548ef52da8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.261053] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.261121] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.261268] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.261341] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91e3865c-9322-423a-9d64-5c548ef52da8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.262075] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01dce4c1-af3a-4e00-a26c-16f52625131a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.262257] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.262299] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.262427] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.262502] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01dce4c1-af3a-4e00-a26c-16f52625131a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.263186] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d88934f6-85c4-4f45-a1fc-042377e3901a taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.263291] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.263353] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.263499] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.263555] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d88934f6-85c4-4f45-a1fc-042377e3901a',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.264269] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44494650-6b02-4361-a53d-fb11ecaa53f2 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.264383] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.264448] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.264595] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.264668] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44494650-6b02-4361-a53d-fb11ecaa53f2',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.265437] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f159d71-0083-4a40-882f-2a28e3868c96 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.265539] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.265609] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.265755] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.265851] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f159d71-0083-4a40-882f-2a28e3868c96',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.266498] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.266605] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.266689] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.266875] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.266950] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ffb70f8-4012-40ec-b9e7-bc37e90e6e70',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.267620] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fc519de-4252-44ff-ace7-b0a5f3000ccf taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.267727] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.267791] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.267936] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.268013] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fc519de-4252-44ff-ace7-b0a5f3000ccf',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.268759] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.268894] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.268992] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.269166] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.269256] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a66f6cb4-94dc-4701-ac62-f6c6e4d4e305',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.270193] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.270327] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.270394] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.270541] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.270613] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.271297] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6612b52-6412-47ab-8918-14b6b8bca0cb taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.271414] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.271478] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.271649] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.271729] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6612b52-6412-47ab-8918-14b6b8bca0cb',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.299187] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.299365] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.299410] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.299614] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.302488] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.302616] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.303281] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.303368] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.318324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.318432] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 705505ff-4cd1-493a-b249-a5178fb4ee23 is going to be deleted. [ 1505.319270] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.319477] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.342857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.342989] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88a75cae-9123-4d4d-9e51-add1196ab1f2 is going to be deleted. [ 1505.343918] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.344158] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.364127] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.364127] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4672e8d-a5ca-46f8-8d7b-adf4da6e472b is going to be deleted. [ 1505.388418] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.388633] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.388633] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.388863] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.388958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.389095] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-705505ff-4cd1-493a-b249-a5178fb4ee23" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.400059] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.400244] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.400244] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.400454] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.400538] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.400657] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88a75cae-9123-4d4d-9e51-add1196ab1f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.408396] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.408565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.408612] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.408764] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.408849] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.408962] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4672e8d-a5ca-46f8-8d7b-adf4da6e472b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.793395] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.793808] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.793808] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.793808] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.793954] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.794070] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.794132] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.794258] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.794339] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.794422] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.794506] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f220ab4-28c5-4bb5-8455-bdaa6e463ad4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.835042] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.835246] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.835293] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.835525] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.838048] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.838048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.838475] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.838593] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.839243] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.839339] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.840051] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.840180] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.840753] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.840842] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.841901] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.842015] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.842731] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.842838] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.843493] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.843585] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.844262] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.844355] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.845026] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.845123] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.845677] env[66994]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1505.846117] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.846210] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.846796] env[66994]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1505.847169] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.847262] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.847857] env[66994]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1505.848228] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.848318] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.848896] env[66994]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1505.849269] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.849358] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.850018] env[66994]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1505.850409] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.850552] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.860550] env[66994]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1505.860949] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.861074] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f159d71-0083-4a40-882f-2a28e3868c96 is going to be deleted. [ 1505.861932] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.862157] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.880107] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.880255] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 841e623a-3249-4bd3-878a-817068626c8a is going to be deleted. [ 1505.881012] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.881223] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.898125] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.898283] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8 is going to be deleted. [ 1505.899043] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.899247] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.920725] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.920926] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.921735] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.921845] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cde16ce-be95-4b19-a4ea-e24f03fb1476 is going to be deleted. [ 1505.922671] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.922878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.932743] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.932918] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.940846] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.940971] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ffb70f8-4012-40ec-b9e7-bc37e90e6e70 is going to be deleted. [ 1505.941882] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.942106] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.960438] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.960616] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.976818] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.976974] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d88934f6-85c4-4f45-a1fc-042377e3901a is going to be deleted. [ 1505.977857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.978089] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.051352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.051526] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01dce4c1-af3a-4e00-a26c-16f52625131a is going to be deleted. [ 1506.052403] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.052676] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.057413] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.057622] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.078015] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.078224] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.092581] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.092789] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.104549] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.104714] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fc519de-4252-44ff-ace7-b0a5f3000ccf is going to be deleted. [ 1506.105634] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.105859] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.148973] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.149175] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44494650-6b02-4361-a53d-fb11ecaa53f2 is going to be deleted. [ 1506.150084] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.150309] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.198490] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.198681] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a66f6cb4-94dc-4701-ac62-f6c6e4d4e305 is going to be deleted. [ 1506.199745] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.199922] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.244490] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.244794] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.277377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.277567] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91e3865c-9322-423a-9d64-5c548ef52da8 is going to be deleted. [ 1506.278845] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.279165] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.298502] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f220ab4-28c5-4bb5-8455-bdaa6e463ad4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1506.305402] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.305645] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.332149] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.332339] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52c814d2-8c46-4f11-a3ab-47d2b96480f7 is going to be deleted. [ 1506.333316] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.333580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.350909] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.350909] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.389531] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.389752] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.406798] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.407050] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6612b52-6412-47ab-8918-14b6b8bca0cb is going to be deleted. [ 1506.407950] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.408226] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.461529] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.461814] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.473944] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.474211] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.483748] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.483922] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18b42095-7bb8-4ea4-a397-e90957ef9f27 is going to be deleted. [ 1506.484857] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.485106] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.590281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.590460] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aaddbb4b-3076-42ef-afd8-2dcbedf8773e is going to be deleted. [ 1506.591378] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.591541] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.613857] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.614121] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.651448] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.651697] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34a807f7-3865-4ec7-9af1-5f447e70423b is going to be deleted. [ 1506.652609] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.652833] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.652929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.653097] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f159d71-0083-4a40-882f-2a28e3868c96" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.653294] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.653476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.653565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.653701] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-841e623a-3249-4bd3-878a-817068626c8a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.654239] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.654412] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.654509] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.654629] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de029c8c-73a4-4af5-b4f6-c2ac6fff7dd8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.654760] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.654923] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.655009] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.655124] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cde16ce-be95-4b19-a4ea-e24f03fb1476" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.655248] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.655388] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.655461] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.655568] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ffb70f8-4012-40ec-b9e7-bc37e90e6e70" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.655694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.655831] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.655903] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.656016] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d88934f6-85c4-4f45-a1fc-042377e3901a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.656144] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.656280] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.656354] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.656456] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01dce4c1-af3a-4e00-a26c-16f52625131a" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.656596] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.656743] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.656817] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.656929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fc519de-4252-44ff-ace7-b0a5f3000ccf" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.657064] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.657204] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.657261] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.657376] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44494650-6b02-4361-a53d-fb11ecaa53f2" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.657497] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.657632] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.657703] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.657810] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a66f6cb4-94dc-4701-ac62-f6c6e4d4e305" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.657930] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.658076] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.658148] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.658255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91e3865c-9322-423a-9d64-5c548ef52da8" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.658377] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.658508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.658580] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.658694] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52c814d2-8c46-4f11-a3ab-47d2b96480f7" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.658815] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.658952] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.659048] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.659138] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18b42095-7bb8-4ea4-a397-e90957ef9f27" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.670087] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.670309] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.670309] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.670459] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.670540] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.670654] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6612b52-6412-47ab-8918-14b6b8bca0cb" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.720387] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.720602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.720602] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.720835] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.720940] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.721079] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aaddbb4b-3076-42ef-afd8-2dcbedf8773e" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.800947] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4: rpc.has_security_group_logging(os_id): False [ 1506.840204] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.840476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.840476] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.840658] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.842352] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.842352] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.867867] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.868216] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.868314] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.868396] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.868576] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.868660] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.868777] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 is going to be updated. [ 1506.869865] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.870056] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.870141] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.870254] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34a807f7-3865-4ec7-9af1-5f447e70423b" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.950330] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.950565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.950565] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.950715] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.950854] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.986083] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 in Status: IN_PROGRESS for 2s [ 1509.139926] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 in Status: SUCCESS [ 1509.139926] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.249868] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1510.249868] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1515.250967] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1515.251303] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1520.252221] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1520.252599] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1525.253549] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1525.253960] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1530.255180] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1530.255640] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1535.256869] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1535.256869] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1540.257703] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1540.258258] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1545.259159] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1545.259554] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1550.260920] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1550.261329] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1555.262249] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1555.262741] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1557.185552] env[66994]: INFO networking_nsxv3.common.synchronization [req-576d1c6e-a103-4887-a634-21aad85fa097 req-1f73c3f4-e19c-493e-ab16-61f95d158f11 tempest-AttachVolumeTestJSON-954084012 tempest-AttachVolumeTestJSON-954084012-project-member] Enqueued Resource ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 with Priority: HIGHEST for action security_group_members [ 1557.185934] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 with Priority: HIGHEST for action security_group_members [ 1557.186259] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.186392] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.186457] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.186649] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.186857] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.186958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.187050] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.187249] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.187324] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.187419] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f220ab4-28c5-4bb5-8455-bdaa6e463ad4',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1557.691675] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.691911] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.691911] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.692200] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.692351] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.692602] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.692785] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.692872] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.693083] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.693223] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.693362] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 is going to be updated. [ 1557.721029] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1557.721255] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1557.721443] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1557.721685] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1557.721847] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.736382] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 in Status: IN_PROGRESS for 2s [ 1559.747476] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 in Status: SUCCESS [ 1559.747844] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f220ab4-28c5-4bb5-8455-bdaa6e463ad4 deletion is rescheduled due to dependency. [ 1559.747844] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f220ab4-28c5-4bb5-8455-bdaa6e463ad4" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.899228] env[66994]: INFO networking_nsxv3.common.synchronization [None req-739ae588-2fbd-4bd9-8bc3-d9285cd4d487 tempest-AttachVolumeTestJSON-954084012 tempest-AttachVolumeTestJSON-954084012-project-member] Enqueued Resource ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f with Priority: HIGHEST for action security_group_rules [ 1561.899228] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f with Priority: HIGHEST for action security_group_rules [ 1561.899527] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.899593] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.899635] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.899872] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.899962] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1561.984787] env[66994]: INFO networking_nsxv3.common.synchronization [None req-11d22cc5-b236-4fa4-ad05-b994cc58c9c8 tempest-AttachVolumeTestJSON-954084012 tempest-AttachVolumeTestJSON-954084012-project-member] Enqueued Resource ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f with Priority: HIGHEST for action security_group_rules [ 1561.985339] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f with Priority: HIGHEST for action security_group_rules [ 1561.985662] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.985765] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.421986] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.422221] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.422267] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.422477] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.422559] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.422659] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f already deleted. [ 1562.422741] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.422878] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.423051] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.423156] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.942043] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.942455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.942455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.942455] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.942556] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.942634] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f already deleted. [ 1562.942710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.986240] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1566.986686] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1567.335633] env[66994]: INFO networking_nsxv3.common.synchronization [req-7b62daa1-7fa6-4f00-b311-8ed968b8055d req-eae00674-f61f-4a50-b11a-ed16ac64365c tempest-AttachVolumeTestJSON-954084012 tempest-AttachVolumeTestJSON-954084012-project-member] Enqueued Resource ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f with Priority: HIGHEST for action security_group_members [ 1567.336196] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f with Priority: HIGHEST for action security_group_members [ 1567.336504] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.336624] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.336688] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.336940] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.337119] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.337223] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.337281] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.337432] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.337544] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.337593] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1567.631351] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.631549] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "network-442" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.631672] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "network-442" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.631947] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "network-442" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.632267] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.632428] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.632897] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.633205] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.633388] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.633605] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1567.633718] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] NeedRegenerationException {{(pid=66994) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1567.633823] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] no value, waiting for create lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1567.633929] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] value creation lock acquired {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1567.634047] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] No value present for key: 'zone-id' {{(pid=66994) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1567.634155] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Calling creation function for not-yet-present value {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1567.634330] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1567.657954] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1567.658178] env[66994]: DEBUG dogpile.cache.region [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66994) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1567.658389] env[66994]: DEBUG dogpile.lock [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Released creation lock {{(pid=66994) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1567.658590] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "network-442" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.659015] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock port-412084b4-07d2-434a-be83-8694a8547ee9 taken with stack trace [, , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.659250] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "port-412084b4-07d2-434a-be83-8694a8547ee9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.659401] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "port-412084b4-07d2-434a-be83-8694a8547ee9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.659785] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "port-412084b4-07d2-434a-be83-8694a8547ee9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.659986] env[66994]: DEBUG networking_nsxv3.api.rpc [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('412084b4-07d2-434a-be83-8694a8547ee9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1567.840111] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.840397] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.840397] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.840508] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.840573] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.840778] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.840877] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.840933] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.841102] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.841179] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.841268] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f already deleted. [ 1567.841346] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.162820] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.163259] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.163259] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.163415] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.163631] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.163796] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Segment Port 412084b4-07d2-434a-be83-8694a8547ee9 not found, creating... [ 1568.164077] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.164233] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.164346] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.164595] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.164735] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.165015] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.165174] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.165291] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.165499] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.165630] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.165763] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Resource: SegmentPort with ID: 412084b4-07d2-434a-be83-8694a8547ee9 is going to be created. [ 1568.185756] env[66994]: DEBUG networking_nsxv3.common.locking [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.185965] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.186095] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.186385] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.186672] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.186838] env[66994]: DEBUG oslo_concurrency.lockutils [None req-558e99b2-78e9-45fd-8242-83c5e892167d None None] Releasing lock "port-412084b4-07d2-434a-be83-8694a8547ee9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.873278] env[66994]: INFO networking_nsxv3.common.synchronization [req-7b62daa1-7fa6-4f00-b311-8ed968b8055d req-c935c0ca-a528-41f3-982c-366ffa8ee671 service nova] Enqueued Resource ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f with Priority: HIGHEST for action security_group_rules [ 1568.873450] env[66994]: INFO networking_nsxv3.common.synchronization [req-7b62daa1-7fa6-4f00-b311-8ed968b8055d req-c935c0ca-a528-41f3-982c-366ffa8ee671 service nova] Enqueued Resource ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f with Priority: HIGHEST for action security_group_members [ 1568.873585] env[66994]: INFO networking_nsxv3.common.synchronization [req-7b62daa1-7fa6-4f00-b311-8ed968b8055d req-c935c0ca-a528-41f3-982c-366ffa8ee671 service nova] Enqueued Resource ID: 412084b4-07d2-434a-be83-8694a8547ee9 with Priority: HIGHEST for action port [ 1568.874106] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f with Priority: HIGHEST for action security_group_rules [ 1568.874246] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f with Priority: HIGHEST for action security_group_members [ 1568.874339] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 412084b4-07d2-434a-be83-8694a8547ee9 with Priority: HIGHEST for action port [ 1568.874611] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.874727] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.874797] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.874987] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.875076] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.876326] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.876551] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.876631] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.876790] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.876939] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.877050] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.877109] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.877250] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.877319] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.877409] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.878808] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock port-412084b4-07d2-434a-be83-8694a8547ee9 taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1568.878929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-412084b4-07d2-434a-be83-8694a8547ee9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1568.878929] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-412084b4-07d2-434a-be83-8694a8547ee9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1568.879203] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-412084b4-07d2-434a-be83-8694a8547ee9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1568.879267] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('412084b4-07d2-434a-be83-8694a8547ee9',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.377282] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.377282] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.380062] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.381255] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 412084b4-07d2-434a-be83-8694a8547ee9 with status ACTIVE [ 1569.381255] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.381433] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.381433] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.381635] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.381746] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.381903] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.382014] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.382074] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.382278] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.382335] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.382529] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.382589] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.382655] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.382787] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.382893] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.382952] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 412084b4-07d2-434a-be83-8694a8547ee9 is going to be updated. [ 1569.404614] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.404949] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.404949] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.405125] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.405249] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.405360] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-412084b4-07d2-434a-be83-8694a8547ee9" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.881661] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1570.384532] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.384958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.384958] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.385078] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.385137] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.385241] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f is going to be created. [ 1570.410270] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.410490] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.410490] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.410696] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.410872] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.419815] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f in Status: UNINITIALIZED for 2s [ 1572.430722] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f in Status: SUCCESS [ 1572.431131] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1572.431258] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.431588] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.431867] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1572.432065] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1572.432188] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1572.432432] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1572.432571] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1572.432712] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1572.432854] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1572.934832] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.436989] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f: rpc.has_security_group_logging(os_id): False [ 1573.454387] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.454600] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.454600] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.454824] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.454930] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.455193] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.455302] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.455365] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.455523] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.455610] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.455701] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f is going to be created. [ 1573.515153] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.515411] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.515411] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.515551] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.515728] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.527033] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f in Status: IN_PROGRESS for 2s [ 1573.875135] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1573.875350] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1575.540793] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f in Status: SUCCESS [ 1575.541193] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.876050] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1578.876482] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1583.877093] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1583.877563] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1588.878329] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1588.878682] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1593.879590] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1593.879590] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1598.880733] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1598.881148] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1603.881771] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1603.882234] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1608.883316] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1608.883709] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1613.884822] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1613.885226] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1618.886427] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1618.886828] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1623.887419] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1623.887849] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1628.888811] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1628.889159] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1633.889951] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1633.890437] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1638.891336] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1638.891761] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1643.892721] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1643.893162] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1645.582473] env[66994]: INFO networking_nsxv3.common.synchronization [req-fc3e3add-3c4c-4c38-9772-ba0719962c02 req-b2d7bcee-8ea4-4420-b7af-59a870d4bca5 tempest-AttachVolumeTestJSON-954084012 tempest-AttachVolumeTestJSON-954084012-project-member] Enqueued Resource ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f with Priority: HIGHEST for action security_group_members [ 1645.583090] env[66994]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f with Priority: HIGHEST for action security_group_members [ 1645.583423] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f taken with stack trace [, , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1645.583539] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1645.583599] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1645.584170] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1645.584357] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1645.584496] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1645.584559] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1645.584705] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1645.584786] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1645.584893] env[66994]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f',) {} {{(pid=66994) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1646.087645] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1646.087896] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1646.087896] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1646.088066] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1646.088163] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1646.088373] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1646.088491] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1646.088610] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1646.088722] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1646.088801] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1646.088917] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f is going to be updated. [ 1646.126212] env[66994]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66994) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1646.126385] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1646.126486] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1646.126632] env[66994]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1646.126788] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1646.137425] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f in Status: IN_PROGRESS for 2s [ 1648.149239] env[66994]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f in Status: SUCCESS [ 1648.149556] env[66994]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f deletion is rescheduled due to dependency. [ 1648.149710] env[66994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b9de1b-0b7e-4bb3-8d4f-a750b834c88f" {{(pid=66994) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1650.584828] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1650.584828] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1655.585961] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1655.586476] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1660.587396] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1660.587668] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1665.588922] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1665.589325] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1670.590371] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1670.590794] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1675.591625] env[66994]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1675.592085] env[66994]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0